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the voice application for an TVR. 
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SYSTEM AND PROCESS FOR DEVELOPING A VOICE APPLICATION 
FIELD OF THE INVENTION 

The present invention relates to a system and process for generating a voice application. 

5 

BACKGROUND 

A voice application is a software application that provides an interactive audio interface, 
particularly a speech interface, on a machine, such as an Interactive Voice Response (IVR) 
system, IVRs, such as Intel's Dialogic™ IVR, are used in communications networks to 
10 receive voice calls from parties. The IVR is able to generate and send voice prompts to a 
party and receive and interpret the party's responses made in reply. 

Voice extensible markup language, or VoiceXML, is a markup language for voice or 
speech-driven applications. VoiceXML is used for developing speech-based telephony 

15 applications, and also enables web-based content to be accessed via voice using a 
telephone. VoiceXML is being developed by the VoiceXML Forum, and is described at 
http://www.voicexml.org . Due to the verbose nature of VoiceXML, it can be cumbersome 
to develop VoiceXML-based applications manually using a text or XML editor. 
Consequently, voice application development systems are available that allow voice 

20 applications to be developed by manipulating graphical elements via a graphical user 
interface rather than coding VoiceXML directly. However, these systems are limited in 
their ability to assist a developer. It is desired to provide a process and system for 
developing a voice application that improves upon the prior art, or at least provide a useful 
alternative to existing voice application development systems and processes. 

25 

SUMMARY OF THE INVENTION 

In accordance with the present invention, there is provided a process for developing a 
voice application, including: 
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generating graphical user interface components for defining execution paths of said 
application by arranging dialog elements in a tree structure, each path through said tree 
structure representing one of said execution paths; 

generating said dialog elements on the basis of predetermined templates and 
5 properties of said dialog elements, said properties received from a user via said graphical 
user interface components, each of said dialog elements corresponding to at least one voice 
language template; and 

generating at least one voice language module for said application on the basis of 
said at least one voice language template and said properties. 

10 

The present invention also provides a system for use in developing a voice application, 
including: 

a dialog element selector for defining execution paths of said application by 
selecting dialog elements and adding said dialog elements to a tree structure, each path 
15 through said tree structure representing one of said execution paths; 

a dialog element generator for generating said dialog elements on the basis of • 
predetermined templates and properties of said dialog elements, said properties received 
from a user of said system, each of said dialog elements corresponding to at least one voice 
language template; and 

20 a code generator for generating at least one voice language module for said 

application on the basis of said at least one voice language template and said properties. 

The present invention also provides a graphical user interface for use in developing a voice 
application, said interface including graphical user interface components for defining 
25 execution paths of said application by arranging configurable dialog elements in a tree 
structure, each path through said tree structure representing one of said execution paths, 
and said dialog element components may include one or more of: 

a start dialog component for defining the start of said application; 
a variables component for use in defining variables for said application; 
30 a menu component for defining a menu; 

a menu choice component for defining a choice of said menu; 
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a decision component for defining a decision branching point; 

a decision branch component for defining a test condition and an execution branch 

of said decision branching point; 

a form component for defining a form to collect input from a caller; 
5 a record component for recording audio 

a speaker component for playing prompts, 

a local processing component for defining local processing; 

a remote processing component for performing processing on a remote system; 

a loop component for defining an execution loop; 
10 a loop call component for calling said loop; 

a loop next component for proceeding to the next cycle of said loop; 

a loop break component for breaking out of said loop; 

a subroutine component for defining a subroutine; 

a subroutine call component for calling said subroutine; 
1 5 subroutine return component for returning from said subroutine; 

a jump component for defining a non-sequential execution path to a dialog element 

a transfer component representing the transfer of a call to another number 

a hotwords component for defining a word or phrase and a non-sequential 

execution path to a dialog element to be followed upon receipt of said word or 
20 phrase; and 

an end component for defining an end of said application. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments of the present invention are hereinafter described, by way of 
25 example only, with reference to the accompanying drawings, wherein: 

Figure 1 is a block diagram showing a preferred embodiment of a voice application 
development system connected to an IVR via a network, and a telephone connected to the 
IVR via the PSTN; 

Figure 2 is a schematic diagram of the voice application development system, 
30 showing how a voice application is developed; 
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Figure 3 is a flow diagram of a voice application development process executed by 
the system; 

Figure 4 is a screenshot of a graphical user interface of the voice application 
development system; 

5 Figure 5 is a screenshot of a dialog element selection bar of the graphical user 

interface; and 

Figure 6 is a flow diagram of a code generation process executed by the system. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

10 As shown in Figure 1, a voice application development system 100 can be connected to a 
VoiceXML-enabled interactive voice response system (IVR) 102 via a communications 
network 104. The system 100 executes a voice application development process which 
allows an application developer to develop a speech based application using a graphical 
user interface of the system 100. The application can then be transferred to the IVR 102 via 

15 the network 104. A standard telephone 106 can be used to access the IVR 102 via the 
public switched telephone network (PSTN) 108, allowing a user of the telephone 106 to 
interact with the speech based application simply by speaking into the telephone 106 to 
provide speech input to the application in response to voice prompts provided by the IVR 
102 from the application. In the described embodiment, the voice application development 

20 system 100 is a standard computer system, such as an Intel™-based personal computer 
running a Microsoft Windows™ operating system, and the voice application development 
process is implemented by software modules stored on hard disk storage of the voice 
application development system 100. However, it will be apparent to those skilled in the 
art that at least parts of the voice application development process can be alternatively 

25 implemented by dedicated hardware components such as application-specific integrated 
circuits (ASICs). The voice application runs on the IVR 102, which may be an Intel 
Dialogic™ IVR with Nuance's Voice Web Server™ software. The network 104 may be 
any secure communications network that enables voice applications to be loaded onto the 
IVR 102, such as an Ethernet LAN or TCP/IP network. 

30 



As shown in Figure 2, the voice application development system 100 includes a dialog 
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editor module 202, a dialog transformer module 204, an application builder module 206, 
an IVR code generator 208, other application development modules 210, VoiceXML 
templates 212, and EMCAscript templates 230. The voice application development system 
100 constitutes an integrated development environment (IDE) for the development of 
5 speech based applications. The system 100 executes an application development process, 
as shown in Figure 3, that allows a user of the system 100 to develop a voice application 
for a particular IVR platform. 

When the process begins, the system 100 generates a graphical user interface, as shown in 
10 Figure 4. The interface is in the form of a window 400 with a project pane 402, a tools 
pane 404, and a messages pane 406. The window 400 also includes a main menubar 408 
and a main toolbar 410. The main menubar 408 includes a Tools menu that provides access 
to a number of modules of the system 100 that are used to develop voice applications, as 
described below, and the tools pane 404 provides an interface to each tool when that tool is 
15 executed. 

To develop a speech based application; a user of the system 100 can create a new project 
or open a saved project by selecting a corresponding menu item from the "Files" menu of 
the main menubar 408. The dialog editor 202 is then executed, and a tabbed dialog panel 
20 411 is added to the tools pane 404, providing an interface to the dialog editor 202, and 
allowing the user to define an execution flow, referred- to as a dialog, for the application. 
The dialog panel 411 includes a dialog pane 412, a dialog element toolbar 414 referred to 
as the dialog palette, a dialog element properties pane 416, and a dialog element help pane 
418. 

25 

An application can be built from a set of seventeen dialog elements represented by icons in 
the dialog palette 414, as shown in Figures 4 and 5. Each element represents a complete or 
partial component of the voice application, such as a menu, a menu choice, a form, an 
execution loop, a speech prompt, and so on. The full set of dialog components is given in 
30 Appendix A. A dialog element is added to the dialog by selecting the element from the 
dialog palette 414 using a pointing device of the system 100 such as a mouse or tablet, and 
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placing the selected dialog element on the dialog editor pane 412 using a drag-and-drop 
action. Each dialog element has a number of properties that can be set by the user. Once 
placed in the dialog editor pane 412, an instance of the selected dialog element is added to 
the dialog and its properties can be set. When a dialog element instance in the dialog editor 
5 pane 412 is selected, its property names and associated values are displayed in the 
properties pane 416. The properties pane displays the name of each property, and includes 
controls such as check boxes and buttons to allow the user to modify the values of existing 
properties, and to add or delete new properties. The dialog element help pane 418 displays 
help information for the selected element, facilitating the rapid development of the 
10 application. 

The execution flow of the application is defined by adding dialog elements to the dialog 
editor pane 412, setting the properties of the dialog elements, and defining the execution 
order of the dialog elements. The latter is achieved by dragging a dialog element and 

15 dropping it on top of an existing dialog element in the dialog editor pane 412. The dropped 
element becomes the next element to be executed after the element that it was dropped 
onto. The sequence and properties of dialog elements on the dialog editor pane 412 defines 
a dialog. Thus a dialog represents the execution flow of a voice application as a sequence 
of dialog elements. This sequence represents the main flow of the application and provides 

20 a higher-level logical view of the application that is not readily evident from the 
application's VoiceXML code. Thus the dialog provides a clear and logical view of the 
execution of the application, hi addition to the main flow, non-sequential execution 
branches can be created by using a Jump dialog element. However, such non-sequential 
execution is not represented in a dialog. A subroutine is represented by an icon in the 

25 project pane 402 and appears as an icon in the dialog editor pane 412 when the main dialog 
is displayed. The execution flow of a subroutine can be displayed by selecting its icon in 
the project pane 402. 

The sequencing of a dialog is facilitated by enforcing strict rules on dialog elements and by 
30 including explicit links in the dialog code to transition from one dialog element to the next. 
In contrast to arbitrary VoiceXML code whose execution can be completely non-sequential 
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due to the presence of "GOTO" tags, a dialog generated by the system 100 has a tree 
structure, with each path through the tree representing a possible path of dialog execution. 
This allows the dialog flow to be readily determined and displayed using high level 
graphical dialog elements, which would be much more difficult with arbitrary VoiceXML. 

5 

An application can be saved at any time by selecting a "Save" menu item of the "File" 
menu of the menubar 410. When an application is saved, the application dialog is 
translated into an extended VoiceXML format by the dialog transformer 204. Each dialog 
element in the dialog flow is first translated into corresponding VoiceXML code. Each of 
10 the seventeen dialog elements corresponds to one of the seventeen VoiceXML templates 
212 that performs the functi onality of that element. A VoiceXML template is a sequence of 
VoiceXML elements that produces the behaviour that the dialog element represents. It is a 
template because it needs to be configured by the element properties (e.g., m name, test 
condition) which are set by the user, as described above. 

15 

Some dialog elements correspond to similar VoiceXML elements (e.g., a Menu dialog 
element corresponds to a VoiceXML <menu> element), while others map onto a complex 
sequence of VoiceXML elements (e.g., a Loop dialog element corresponds to multiple 
VoiceXML <form> elements, each form specifying the next form to execute in an iterative 
20 loop). However, even dialog elements that correspond to similar VoiceXML elements 
represent more functionality than the equivalent VoiceXML element. For example, a Menu 
dialog element allows prompts to be set by the user, and the Menu dialog element actually 
maps onto a block of VoiceXML code that contains a <menu> element with embedded 
<prompt>, <audio>, and other XML elements. 

25 

Each dialog element's VoiceXML template is separate from the next and can be sequenced 
to produce the dialog flow. The sequencing is achieved by a reference at the bottom of 
each element's template to the next element's template, which causes the templates to be 
executed in the desired order. 

30 



WO 2004/010678 



PCT/AU2003/000939 



The translation from high-level dialog elements into VoiceXML proceeds as follows. The 
dialog elements are stored in a tree structure, each branch of the tree corresponding to a 
path in the dialog flow. The tree is traversed in pre-order traversal to convert each element 
visited into VoiceXML. For each visited dialog element, VoiceXML code is generated 
5 from its corresponding VoiceXML template by filling in the. missing or configurable parts 
of the template using the element properties set by the user, and adding a link to the next 
element's VoiceXML code at the bottom of the current element's generated VoiceXML 
code. 

10 Although the forward transformation from dialog flow to VoiceXML is relatively 
straightforward, the reverse transformation from VoiceXML to dialog flow is more 
difficult. The sequencing of dialog elements can be recreated from the generated 
VoiceXML, but property settings for the elements may not be available because some 
information in the dialog elements is lost when they are converted to VoiceXML. This lost 

15 information may not fall within the scope of VoiceXML, and hence, cannot be naturally 
saved in VoiceXML code. For example, type information for a Form element is used to 
generate the grammar for that Form. However, the VoiceXML code simply needs to 
reference the generated Grammar File and is not concerned with the type information 
itself Thus, the mapping of the Form element to" equivalent VoiceXML code does not 

20 include the type information. 

To facilitate the reverse translation from VoiceXML code to dialog, the dialog transformer 
204 modifies the VoiceXML code by inserting additional attributes into various element 
tags, providing dialog element information, that cannot be stored using the available 

25 VoiceXML tags. The resulting file 214 is effectively in an extended VoiceXML format. 
The additional attributes are stored in a separate, qualified XML namespace so that they do 
not interfere with the standard VoiceXML elements and attributes, as described in the 
World Wide Web Consortium's (W3C) Namespaces in XML recommendation, available at 
http://www.w3 .org/TR/1 999/REC-xml-names - 1 9990 1 1 4/ . This facilitates the parsing of 

30 extended VoiceXML files. . 
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Specifically, an extended VoiceXML file can include the following namespace declaration: 

<vxml version= "1.0" xmlns : lq= "http : / /www . telstra . com . au/LyreQues t " > 

This defines a namespace prefix "lq" as bound to the universal resource indicator (URI) 
http://www.telstra.com.au/LweQuest . Subsequently, the file may contain the following 
extended VoiceXML: 



<f o rm id= ,, SUBROUTINECALL_getMembership ,t 
lg : element = " SubroutineCal 1 " [ 



10 



15 



lq : name= "getMembership " 

lg: calls="subl . vxml#getMembershipSub" > 
<subdialog name="subcall" 

src= n subl .vxml#SUBROUTINE_getMernbershipSub"> 
<filled> 

<assign name= "getMembership . enrich m embership " 

expr= "subcall . enrich_membership «' I lg : element^ " Output » / > 

</filled> 1 

</subdialog> 
<block name="link"> 

<goto next= M #REMOTE_book_f light" /> 
20 </block> 
</f orm> 

where the indicated XML tag attributes provide the additional dialog element information, 
and the remaining code is standard VoiceXML. The additional or extended attributes 
25 include the lq namespace prefix. The lq: element, lq:name, and lq: calls attributes 
indicate, respectively, the dialog element that the VoiceXML corresponds to, the name 
given to that element by the user, and the package and name of the Subroutine element that 
is being called by the SubroutineCall element. Other elements will have different extended 
attributes. 

30 



The equivalent code in VoiceXML omits the extended attributes, but is otherwise identical: 

35 <form id= ,, SUBROUTINECALL_getMembership'»> 

<subdialog name= "subcall " 

src= " subl . vxml#SUBROUTINE_getMembershipSub 11 > 
<filled> 



40 



<assign name= "getMembership . enrich_membership n 
expr=" subcall . enrich_membership n /> 
</filled> 
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</subdialog> 
<block name =" 1 ink H > 

<goto next = " #REMOTE_book_f light " / > 
</block> 
5 </form> 

Two extended VoiceXML files, including all the available extended attributes, are listed in 
Appendix B. 



10 When the application is saved, the dialog transformer 204 also generates a number of other 
files, including a project file 216, package description files 218, and type description files 
220. The project file is given a filename extension of lqx", and contains information 
about the packages (i.e., self-contained groups of files) and other data files making up a 
project of the voice application development system 100. 

15 

An example project file is listed below. Within the project file, the project is defined by a 
''project" XML element that defines the project name as "mas". Within the "project" 
element are four sequential "folder" elements that define subdirectories or folders of the 
directory containing the project file, respectively named Packages, Transcripts, Scenarios, 

20 and Generated Code. These folders contain respectively the project's packages, transcripts 
of text, scenarios of interaction between the corresponding application and a user, and 
VoiceXML code and grammar generated for one or more specific IVR platforms. Within 
the "Packages" folder element is a "package" element giving the location and name of any 
packages used by the project. The "folder" elements can contain one or more "file" 

25 elements, each defining the type and name of a file within the encapsulating folder. The 
"folder" elements can be nested. 



<?xml version^" 1 . 0 " ?> 
30 <project name="mas"> 

<f older name= n Packages" directory= "packages'^ 

<package directory^ "mas" f ile= "mas .pkg .xml "/> 
</f older> 

<f older name= "Transcripts" directory^ " transcripts M > 
35 <file type="transcript" name="mas . in"/> 

<file type= "negative" name= "mas . negative "/> 
</f older> 

<f older name= "Scenarios" directory^ " scenarios " > 
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. <file type=" scenario" name= "mas . seen"/ > 
<file type="states" name= "mas . states "/> 
</folder> 

<folder name-" Generated Code" directory's" deploy 11 > 
5 < folder name="JSGF Code" directory=" jsgf "> 

</f older > 

<f older name= "Nuance Code" directory= "nuance "■> 
</folder> 
</folder> 
10 </project> 

A package description file is given a filename extension of ".pkg.xml", and contains 
information about data files belonging to an individual Package of a project. An example 
of a package description file for the package named "mas" is given below. The file defines 
15 the project's dialog file as "masivxtnl", four grammar files, four prompt files, and three 
type definition files, containing definitions of user-defined variable types. These files are 
described in more detail below. 



<?xml version="1.0"?> 
20 <package name^'^as^ 

<file type= "dialog" name="mas . vxml »/> 
<file type="grammar n > 

<file type="rulelist" name- "mas . rulelist "/ > 
<file type="cover" name= "mas . cover " /> 
25 <file type="slots" name- "mas . slots » /> 

<file type=" targets 11 name= "mas . targets "/> 
</file> 

<file type= "prompt "> 

<file type="rulelist" name= "mas .prompts . rulelist "/> 
<file type="cover" name- "mas .prompts .cover" /> 
<file type="slots" name="mas .prompts . slots "/> 
<file type- "targets" name= "mas .prompts . targets "/> 
</file> 

<file type="typedef " name="cities . type . xml "/> 
<file type="typedef " name="f are_class . type .xml "/> 
<file type="typedef" name= "collection point . type .xml" /> 
</package> 



30 



35 



A Type description file is given a filename extension of ".type.xml", and contains 
40 information about a user-defined Type used in a Package of a project. An example of the 
file is given below. The file defines an enumerated type named "fare_class" with three 
possible values: "first", "business", and "economy". The "fare_class" type is associated 
with four files, respectively defining rules for the grammar, cover (a set of example 
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phrases), slots (the parameter=value fields that the grammar can return), and targets (more 
specific slot filling information). 

<?xml version="l . 0" encoding= "utf -8 " ?> 
5 <types> 

<enum name="fare_class"> 

<file type=" grammar "> 

<file type= n rulelist n 
name="fare_class . rulelist"/> 
10 <file type= n cover" name= " f are^class . cover" / > 

<file type= n slots" name= " f are_class . slots " / > 
<file type=" targets" name="f are_class . targets "/> 
</file> 

<item name-" first" /> 
15 <item name= "business "/> 

<item name = "economy" /> 
</enum> 
</types> 

20 

Returning to Figure 3, in order to deploy the application on the IVR 102, the application 
dialog is translated into VoiceXML by the application builder 206 at step 604. In addition 
to the dialog, voice applications require grammar and prompts. The application builder 206 
generates grammar files 222 and prompts files 224 automatically, using information 

25 specified by the user and stored in the dialog, such as prompt wordings and Form input 
types. This information is supplied by the user entering typical phrases for 'mixed 
initiative' recognition (i.e., input containing multiple pieces of information). By applying 
generalisation methods to these phrases, a combinator module of the application 
development modules 210 generates a starting grammar set capable of handling a large 

30 number of input phrases. The application builder 206 also invokes the dialog transformer 
204 to create the extended VoiceXML file 214. The grammar 222 and prompts 224 files 
are used by the IVR code generator 208 to generate VoiceXML 226 for the IVR 102. 

A generated grammar file is given a filename extension of rulelist" An example of a 
35 generated grammar file for a flight booking system is: 



. Ask__f light_details_destination Cities :X 2 0 destination=$X . cities 
. Ask_f light_details_departure_point Cities :X 2 0 
departure_point=$X . cities 
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. Ask_f light_details_ticket_class Fare_class :X 2 0 
ticket_class=$X . f are_class 

.Ask_f light__de tail sedate Date:X 2 0 date . day=$X . date . day- 
date . year=$X . date . year date . day_of _week=$X . date . day_of _week 
5 date . month=$X . date .month date . modif ier=$X . date . modifier 
. Form_f light_details booking 2 1 

. Ask_book_f light__conf irmation Conf irmation:X 2 0 
conf irmation=$X . confirmation 

. Ask_get_enrich_number_enrich_number Digits tring :X 2 0 
10 enrich_number=$X . digitstring 

. Ask_get_collection_point_collectionj?oint Collection_jpoint :X 2 0 
collection_jpoint=$X . collection_point 

. Ask_another_f light_second_f light Confirmation^ 2 0 

second_f light=$X . conf irmation 
15 . Ask_get_number_get_number_for_balance Digitstring :X 2 0 

get_number_f or_ba lance = $X . digitstring 

.Menu__main_menu__booking Booking 2 0 

! (Booking booking 3 0 

! ! Booking 1 0 
20 . Menu_main_menu_membership Membership 2 0 

i I Membership membership 3 0 

! ! Membership 1 0 

. Form_f light_details GF_IWantTo : X73 8 book a Fare_class : X74 1 class ticket 
to Cities .-X745 from Cities:X747 on Date:X749 2 1 date . day=$X74 9 . date . day 
25 date. year=$X749. date. year ticket_class=$X74 1 . f are_class 

date . day_of _week=$X74 9 . date . day_of _week date . month=$X74 9 . date . month 
departure joint=$X747 . cities destination=$X745 . cities 
date. modif ier=$X749 .date .modif ier 

.Form_f light_details GF_IWantTo : X75 0 book a Fare_class : X753 class ticket 
30 to Cities:X757 2 1 ticket_class=$X753 . f are_class destination=$X757 . cities 

The first line or rule of this grammar can be used as an example: 

. Ask_f light_details_destination Cities :X 2 0 destination=$X . cities 

35 This grammar rule might be invoked when a flight booking application prompts a customer 
to provide the destination of a flight. The first field, 
.Ask_f light_details_destination, provides the name of the grammar rule. The 
second field, cities :X, indicates that the customer's response x is of type Cities. This type 
is defined by its own grammar that includes a list of available city names. The following 

40 two fields, 2 o, are used for grammar learning, as described in International Patent 
Publication No. WO 00/78022, A Method of Developing an Interactive System. The first 
field indicates the number of training examples that use the grammar rule. The second field 
indicates the number of other rules that refer to the rule. The last field, 
destination=$x. cities, indicates that the result of the rule is that the parameter 
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destination is assigned a value of type Cities having the value of x. A more complex 
example is provided by the last rule : 

. Form_f light_details GF_IWantTo :X750 book a Fare_class :X753 class ticket 
to Cities :X757 2 1 ticket_class=$X753 . f are__class destination=$X757 . cities 

5 In this case, the grammar rule invokes three other grammars: GF__iwantTo, Fare_class, 
and cities and assigns the results to parameters named X75o, X753, and X7.57, 
respectively. This rule defines the application parameters ticket_class and 

destination. 



10 A prompts file is given a filename extension of "prompts.rulelist", and each line of the file 
defines the speech prompt that is to be provided to a user of the application when the 
corresponding element of the dialog is executed. An example of a generated prompts file 

is: 



15 .Goodbye thank you for using this application, goodbye. 1 1 
.Noinput sorry, i did not hear anything. 1 1 
.Nomatch sorry, i did not understand you. 1 1 

. Ask_f light_details_destination where would you like to go 1 1 
. Ask_f light__details_destination_2 please say the destination city name 1 
20 1 

.Help_Ask_f light_details_destination please say the destination. 1 1 
. Ask_f light_details_departurejpoint where would you like to fly from 1 1 
. Ask_f light_details__departure_point_2 please say the departure point 1 1 
. Help_Ask_f light_details_departure_point please say the departure point. 
25 1 1 

. Ask__f light_details_ticket_class what class would you like to fly 1 1 

The format of the prompts file is the same as the grammar file. This allows the prompts to 
be improved through machine learning as though they were a grammar, using a grammar 
30 learning method such as that described in International Patent Publication No. WO 
00/78022, A Method of Developing an Interactive System. 



The generated prompts include dynamically prompts. An example of a dynamic prompt is: 
"You have selected to buy Telstra shares. How many of the Telstra shares would you like 
35 to buy?". The word, "Telstra" is dynamically inserted into the application's prompt to the 



user. 
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The voice application development system 100 generates text-to-speech (TTS) prompts 
within the VoiceXML code that are evaluated on the fly. Although VoiceXML syntax 
allows an expression to be evaluated and played as a TTS prompt, the system 100 extends 
5 this by allowing an ECMAscript or JavaScript function to be called to evaluate each 
variable used in a prompt. By evaluating variables in a function rather than as an inline 
expression, complex test conditions can be used to determine the most suitable prompt 
given the available information in the variables. This might result in a prompt, for 
example, of "six dollars" rather than "six dollars and zero cents". In addition to 
10 automatically generating and incorporate JavaScript function calls in VoiceXML, the 
system 100 also generates the corresponding JavaScript functions by incorporating user- 
supplied prompt text and variables into the JavaScript templates 230. This allows the user 
to develop a voice application with dynamically generated prompts without having to 
manually code any JavaScript. 

15 

For example, an automatically generated function call for a prompt named 
PromptConfimi_payment_details is: 



<field name = " confirm" > 

<grammar src="mas . gsl#Conf irm"/> 
<prompt> 

<value expr="PromptConf irm_jpayment_de tails ( 
payment_details . company, 
payment_details . amount , 
payment_de tails . payment_date) "/> 

< /prompt > 

The corresponding JavaScript prompt function generated by the system 100 is: 



function PromptConf irmjpayment_de tails (company , amount ,payment_date) 
var result; 

result = "the company is " + Bp ay_names (company) + 
"the amount is " + Money (amount ) + 
"the payment date is " + Date (payment_date) + 
"is this correct? "; 

if( valid_string (result) ) 

{ 

. return result; 



20 



25 



30 



35 
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} 

§ 

return result; 

} 

5 

The system 100 represents prompts using a language model that describes all of the 
prompts that can be. played, along with their meanings. This model contains the same type 
of information as a speech recognition grammar, and therefore the prompts to be played 
10 can be represented using a grammar. Prompts to be generated by the application are first 
represented as a grammar to enable that grammar to be improved using techniques such as 
grammar learning, as described in International Patent Publication No. WO 00/78022, A 
Method of Developing an Interactive System. The grammar is subsequently converted into 
JavaScript and referenced by the application's VoiceXML tags, as described above. 

15 

An example of a prompt represented as a grammar is: 

. Conf irm_payment_de tails the company is Bpay_names : xl the amount is 
Money :x2 the payment date is Date:x3 is this correct? 1 
20 company=$xl .company amount . dollars=$x2 . amount . dollars 

amount . cents=$x2 . amount . cents payment_date=$x3 . payment_date 

Returning to Figure 3, after the application has been built at step 604, that is, the extended 
VoiceXML 214, the grammar 222 and the prompts 224 for the application have been 

25 generated by the application builder 206, the application can be tested and further 
developed at steps 606 to 610. Steps 606, 608, 610 and 612 can be executed in any order. 
At step 606, the application can be simulated and refined. This involves simulating the 
execution of the application and refining its accuracy by allowing the user to tag phrases 
that do not match the existing grammar. When user input during testing does not match the 

30 grammar, a dialog box is displayed, allowing the user to tag the phrase and supply the 
correct 1 slot ' or slots corresponding to that input. A slot is a parameter^value pair for the 
application, such as "fare_class=business". A grammar learner module of the application 
development modules 210 then uses a transcript of the simulation to update the application 
grammar 222. New phrases learnt from this grammar are then displayed to the user, who 

35 can manually tag individual phrases as being incorrect. At step 608, the grammar 
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capabilities of the application can be further improved by a Train Grammar tool of the 
application development modules 210. This is similar to the simulate and refine module, 
but allows the user to enter a list of typical user responses for each application prompt. At 
step 610, a Generate Scenarios module of the application development modules 210 
5 generates scenarios of possible interactions between the application and a human. Based on 
these scenarios, the user can determine whether and application prompts need 
improvement. 

When the application has been tested and is ready for use, the IVR code generator 208 
10 executes a code generation process at step 612 to generate pure VoiceXML suitable for a 
particular speech-enabled IVR such as the IVR 102 of Figure 1. As shown in Figure 6, the 
code generation process begins at step 702 by removing the extended attributes from the 
extended VoiceXML file 214 to generate pure VoiceXML. At step 704, prompts 
(including dynamic prompts) in the prompt file 224 are converted into JavaScript 
15 functions. At step 706, these JavaScript functions are incorporated into the pure 
VoiceXML by adding references to the functions in VoiceXML tags, and adding the 
functions themselves to the pure VoiceXML. At step 708, the IVR grammar file 228 is 
generated by translating the application grammar file 222 into a grammar format supported 
by the desired IVR platform, such as Nuance™ GSL or generic VoiceXML 1.0 JSGF 
20 grammar format, as selected by the user. Other grammar formats can be supported in the 
same way. At step 710, references to the IVR grammar file 228 are incorporated into the 
pure VoiceXML. The result is the pure VoiceXML file 226. The VoiceXML file 226 and 
the IVR grammar file 228 are sufficient to deploy the voice application on the IVR 102. 

25 For the purposes of illustration, Appendix C provides a partial listing of a pure VoiceXML 
file corresponding to the first extended VoiceXML file listed in Appendix B. The listing in 
Appendix C includes the VoiceXML with the merged JavaScript for supporting Prompts. 
The JavaScript code is at the end of the listing. 
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Many modifications will be apparent to those skilled in the art without departing from the 
scope of the present invention as herein described with reference to the accompanying 
drawings. 
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APPENDIX A: DIALOG ELEMENTS 



Decision &\ 


Description: 


A point in the dialog where a decision is made to determine which path of execution should 
continue. 


* Notes: 


Each Decision element is followed by one or more Decision-Branch elements. 


Parameters: 


Decision 

Name: a name for this Decision element 




Decision branch Hr! 


Description: 


A path that is followed if the condition is true. 


Notes: 


Can only be added after a Decision element. 


Parameters: 


Branch 

Condition: an ECMAScript expression that if evaluated to true will cause execution to 
continue down this branch, eg. x =- 2, validity == true, currency == f AUD'. Note that 
strings should be quoted in single quotes. An "else" condition is created by enabling the 
Otherwise checkbox. 




Menu - D # 


DESCRIPTION: 


Prompts the user to select from a series of menu choices 


Notes: 


Each Menu element is followed by one or more Menu-Choice. 
Prompts for the menu can include: 

( 1 ) Auto generated prompts (by default); 

(2) User specified prompts; 

(3) Audio file for playing prompts. 

In addition, tapered prompts are supported. 


Parameters: 


Menu 

Name: name for this Menu element. 
Prompts 

Tapered prompts: the tapered prompts played to ask for a menu choice. The system can 
generate a default text prompt based on the menu choices and a default audio file name for 
recording the corresponding audio prompt, or you may enter in your own values. If an audio 
prompt is not required, the "Generate default audio file name" checkbox should be 
unchecked and the "Audio file" text box should be left empty. 

Help prompt: the prompt played when the user requests help. As with tapered prompts, the 
system can generate a default text prompt and audio file name, or you may enter in your 
own. 



5 
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Menu choice Lfij 


Description: 


Defines a specific menu choice 


Notes: 


Can only be added after a Menu element. 

This is the only Element whose name can have a space. 


Parameters: 


Choice 

Choice: a word or phrase for this menu choice. 




Form D 


Description: 


Collects user inputs to fill in a 'form'. 
Defines a type and prompts for each input. 

These can be standard types such as Time and Date, or user defined such as a list of 
products. 


Notes: 


User-deft ned-types need to be first created in the LHS Dialog/Project Files window, by right- 
clicking on 'package' icon. 

Selecting "Hot link" allows jumping to the Form from anywhere in the dialog. 

The Forms support mixed initiative filling of the Fields. 

Other Elements can refer to Form Fields using: "FormName.FieldName". 

When entering Form Fields, default string values need to be in single quotes (eg. 'telstra'). 


Parameters: 


Form 

Name: a name for this Form element. An object with this name will be created to store the 
form fields. Each field can then be accessed as SformName.SfieldName, eg. BuyForm.price. 




Modal: if enabled, then only that input field's grammar is enabled when collecting each 
field; all other grammars are temporarily disabled (including hot-linked global grammars). 
This means that you cannot get out of this form by saying a hotword. For example,- a form 
that collects a login pin should be made modal. 

Confirm All: enable confirmation of all form fields together at the end. 

Hot link: enable jumping to the fonn from anywhere in the document, by creating a 
document grammar for the fonn. 

Input Field 

Name: name of slot to be filled. 
Type: type of slot value. 

Default: default value for slot. If a default is given, the user will not be prompted for the 
field. If the field type is a structured object, the slot will have multiple properties, one for 
each of the object's properties. You may specify a default by filling in some or all of these 
properties, depending on what is valid for a particular type. Note that strings should be 
quoted in single quotes, eg. 'Wednesday. 

Confirm: enable individual confirmation of this field. This is in addition to the form 
confirmation of all fields at the end. 

Input Field Prompts 

Tapered prompts: the tapered prompts played to collect input for this field. The system can 
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generate a default text prompt based on the field name and a default audio file name for 
recording the corresponding audio prompt, or you may enter in your own values. If an audio 
prompt is not required, the "Generate default audio file name" checkbox should be 
unchecked and the "Audio file" text box should be left empty. 

Help prompt: the prompt played when the user requests help. As with tapered prompts, the 
system can generate a default text prompt and audio file name, or you may enter in your 
own. 




Record S§ 


Description: 


Captures a voice recording from the user 


Notes: 


Note that the Record duration is in seconds. Setting it to too high will result in excesive 
memory usage & possible harddisk limit problems. 


PARAMETERS: 


Record 

Name: a name for this Record element. 

MIME-type: MIME-type storage format for the recording. This field may be left blank if 
the IVR does not allow a MIME-type specification. Please consult your IVR documentation 
for supported MIME-types. 

Beep: enable a beep to be sounded before recording starts. 

DTMF Terminate: enable a DTMF key press to terminate the recording. 

Duration: maximum recording time in seconds. 

Confirm: enable confirmation of the recorded material. 

Prompt: the prompt played to ask for a recording. The system can generate a default text 
prompt and a default audio file name for recording the corresponding audio prompt, or you 
may enter in your own values. If an audio prompt is not required, the "Generate default audio 
file name" checkbox should be unchecked and the "Audio file" text box should be left empty. 




Speaker IMS 


Description: 


Plays TTS & audio to the caller. 


Notes: 


Can say variables of predefined types, such as Date, Money, etc. The variables need to be 
declared as a valid object (unless it is created via a Form Field). Eg. User can use local 
processing to declare a variable called price, as follows: price = new Object(); price.dollars = 
10; price.cents = 4; To use it in Speaker, type the following: PromptMoney(price) in a 
Speaker expression fragment. 
To play back predefined Types, such as Money: 

(1) add a Speaker fragment of the type "Expression"; 

(2) enter in the "Expression" text box: PromptType(x), where Type is the predefined type 
name, x is the variable of the predefined type. E.g. If "y" is type money (where 
y.dollars=5 y.cents=0), then entering PromptMoney(y) will result in the following being 
played: "five dollars". 


Parameters: 


Speaker 
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Name: a name for this Speaker element. 




Fragment 




Type: type of prompt fragment. 




Text: a fixed text fragment. The text specifies text-to-speech (TTS) that should be played. 
The audio file URL specifies a recording that should be played, in precedence to the text-to- 
speech, eg. greeting.wav, http://server/weicome.wav. Either of the audio file or the text may 
be left empty to request that only TTS or audio with no alternate text should be played. 




Expression: an evaluated prompt fragment. The ECMAScript expression is evaluated and 
played as text-to-speech (TTS), eg. recordedMessage, counter + 1. To play back a variable of 
a known type, you should use the function PromptType(x), where Type is the name of that 
type, and x is the name of the variable, eg. PromptMoney(BuyForm. price). This is 
particularly important for playing back structured types. The audio expression is evaluated 
and retrieved as an audio file URL for playing, eg. company + \wav\ The expressions may 
reference any variable defined in the package, such as in a Variables element or a Form 
object. Either of the audio expression or the TTS expression may be left empty to request 
that only TTS or audio with no alternate text should be played. 



Local Processing 


Description: 


Local computation. 


Notes: 


This can be any ECMAScript code, eg. functions, statements, function calls. Any variable 
declared in the dialog may be accessed, eg. declared Variables, Form fields, SubroutineCall 
outputs, RemoteProcessing outputs. 


Parameters: 


Local Processing 

Name: a name for this Local Processing element. 

ECMAScript: any arbitrary ECMAScript code, such as variable declarations, if blocks, 
assignment statements, function declarations and function calls, eg. x = x + J; currency = 
'AUD';. Note that strings should be quoted in single quotes. 




Remote Processing © 


Description: 


Call a server-side script (via a HTTP URL) to perform some processing. The script should 
return a VoiceXML document with the results of the processing. 


NOTES: 


Need PHP/CGI running on remote Web server to handle this. Name of the input and output 
parameters needn't be declared in the Variables element. The names of the input and output 
parameters should match what is required at the remote server end. Other Dialog Elements 
can refer to the output of the Remote Processing element using: 
"RemoteProcName.outputName". 

See Chapter 9: Advanced Techniques for more information 


Parameters: 


Remote Processing 

Name: a name for this Remote Processing element. An object with this name will be created 
to store the returned outputs. Each output can then be accessed as 
SremoteProcessingName.Soutput, eg. ValidateP in. validity 

Source URL: the URL of the remote script to execute, eg. http://server/cgi-bin/scriptl . 
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Input 




Name: name of the input parameter to be submitted, eg. price. This is the name that the 
server script expects. 




Value: value of the input parameter to be submitted, eg. BuyForm.price, 1, 'AUD', true, x + 
1. This may be any valid ECMAScript expression. The expression may reference any 
variable defined in the package, such as in a Variables element or a Form object. If the value 
is an ECMAScript object with fields fl, f2, then the object is serialised and submitted 
using the names o.fl, o.f2, assuming o is the declared input name. 




Output 




Name: name of each parameter returned by the remote script, eg. outFieldl. The remote 
script should return a VoiceXML document containing a subdialog form whose return 
namelist includes all these output fields. 



Loop Call M 


Description: 


Calls a Loop to execute a part of a dialog that should be iterated several times. 


Notes: 


A corresponding Loop element is required. 

See Chapter 9: Advanced Techniques for more information 


Parameters: 


Loop Call 

Name: a name for this Loop Call element. 

Source: the loop to call. The loop must be defined in this package. 




Subroutine Call 01 


Description: 


Start a subroutine. Used for breaking bigger programs into smaller components, for ease of 
readability, reuse of code, and support of pre-packaged code. 


Notes: 


A corresponding Subroutine element is required. Input parameter names needn't be declared. 
Ouput parameter names are set by the Subroutine element. Other Dialog Elements can refer 
to the output parameters by calling; ,, SubroutineCallName.OutputPa^amName ,, . 

See Chapter 9: Advanced Techniques for more information 


Parameters: 


Subroutine Call 

Name: a name for this Subroutine Call element. An object with this name will be created to 
store the returned outputs. Each output can then be accessed as SsubName.Soutput, 
eg. ValidatePin.validity. 

Source: the subroutine to call (qualified with the package name). If the declared subroutine 
inputs and outputs have changed, you may need to reselect the subroutine from the Source 
list box to refresh the displayed inputs and outputs. 

Inputs 
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This is a list of the inputs that the called subroutine expects. For each input, you must specify 
an ECMAScript expression whose value will be passed to the subroutine, eg. 0, 
BuyForm.price, pinValidity, 'AUD'. It may reference any variable defined in the package, 
such as in a Variables element or a Form object. Note that strings should be quoted in single 
quotes. Note also that you cannot leave any input value blank. 

Outputs 

This is a list of the outputs that the called subroutine returns. 



Jump Ml 


Description: 


Jump to a predefined block. Can jump to any element in the same MainDialog or Subroutine 
that has a name. 


Notes: 


Valid destinations for Jump: (1) Jumps within a MainDialog; (2) Jump from a Loop in a 
MainPackage to the MainDialog; (3) Within a subroutine. 


Parameters: 


Jump 

Destination: the destination element to jump to. You can only jump within a main dialog or 
within a subroutine. You cannot jump to an element in a loop or in another package. The 
available elements to jump to are presented in the drop-down list box. 




End h§ 


Description: 


Terminate the call. End of dialog 


Notes: 




Parameters: 


Causes execution to terminate immediately 




Transfer Ml 


Description: 


Transfer the call to another number. 


Notes: 




Parameters: 


Transfer 

Name: a name for this Transfer element. 

Destination: a number to dial or an ECMAScript expression that evaluates to such a 
number. A valid number is a string of digits with optional spaces, eg. 1234567, 03 1234567. 
The number may optionally contain a protocol specifier. Please consult your IVR 
documentation for specific supported number formats. 

Connection Timeout: maximum time in seconds to wait for a connection before a failure is 
reported. 




Loop Break 


Description: 


Used within a Loop to break out of the loop. 


Notes: 


Only valid within a Loop 


Parameters: 


Causes execution to break out of the loop immediately. The loop exit message, if any, is not 
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played 



5 



Loop Next Mi 


Description: 


Used within a Loop to indicate the end of one iteration. 


Notes: 


Only valid within a Loop 


Parameters: 


Causes execution of the next iteration of the loop, if the loop test condition evaluates to true. 
The loop step is executed before the condition is evaluated. 




Subroutine Return H 


Description: 


Return from subroutine 


Notes: 


Only valid within a Subroutine 


Parameters: 


Return from a subroutine call. 




Variables il 


Description: 


Declare "global" variables that can be accessed from anywhere within this Package, eg. 
inside a Loop, LocalProcessing, Speaker element. 


Notes: 


Form Fields, Subroutine Call outputs and Remote Processing outputs do not need to be 
declared. They are automatically created. 


Parameters: 


Variables 

Name: a name for the variable. The name should be unique within this package. 

Value: an ECMAScript expression, usually a constant, that sets the initial value for the 
variable, eg. 0, 'cat', true . Note that strings should be quoted with single quotes. The value 
may be left empty to create an ECMAScript undefined value. 




Hotwords If i 


Description: 


Create "hot words" that transition the user to a specified point in the dialog when they are 
uttered by the user. 


Notes: 


Allows the user to jump from one part of the dialog to another if they want to do something 
else, for example. 

Hotwords can only be created in the Main Package, not in Subroutine Packages. 


Parameters: 


Hotwords 

Hotword: a word or phrase that will trigger a jump. 
Destination: the destination element to jump to. 




Start Dialog © 


Description: 


The entry point for the application. 


Notes: 


This is automatically created when you create a new project. Only the first package has a 
Start Dialog element. Each project must have one and only one Start Dialog element. You 
cannot add more Start Dialogs, nor delete any. 
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Parameters: 



Start Dialog 

This is the entry point for the application. 
Name: a name for this Start Dialog element 

Quit Prompt: the prompt played when the user has requested to quit, after which the dialog 
will terminate. The system can generate a default text prompt and a default audio file name 
for recording the corresponding audio prompt, or you may enter in your own values. If an 
audio prompt is not required, the "Generate default audio file name" checkbox should be 
unchecked and the "Audio file" text box should be left empty. 

No Input Prompt: the prompt played when no input is detected while the user is being 
asked for a response. The user is then reprompted for a response. As with the Quit prompt, 
the system can generate a default text prompt and a default audio file name, or you may enter 
in your own values. 

No Match Prompt: the prompt played when the detected user response cannot be 
recognised by the system. The user is then reprompted for another response. As with the Quit 
prompt, the system can generate a default text prompt and a default audio file name, or you 
may enter in your own values. 



Subroutine ® 



Description: 



This is the entry point for a subroutine. 



Notes: 



Subroutine elements cannot be added to the Main Package. They can only be added to non- 
Main Packages. More than one Subroutine can be added to a non-Main Package. However, 
all Subroutine inputs and outputs must be unique within the Package, ie. no two Subroutines 
can declare the same input name or output name. Furthermore, no input name can be the 
same as an output name. 

The Subroutine element is created by (1) right-clicking on the "Project" icon on the 
Dialogs/Project Files window (LHS) to add a new Package; and (2) right-clicking on a 
Package icon on the Dialogs window (LHS) to add a new Subroutine. 

Each path in the Subroutine should end with a Return element, otherwise the Subroutine will 
not return to the calling dialog. 

See Chapter 9: Advanced Techniques for more information 



Parameters: 



Subroutine 

Name: a name for this Subroutine element. 
Input 

Name: name of each input parameter expected, eg. pin. The input will be declared as a 
document variable that you can access from anywhere within the package. You do not need 
to (re)declare it under the Variables element. 

Output 
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Name: name of each return parameter, eg. validity. The output will be declared as a 
document variable that you can access from anywhere within the package. You do not need 
to (re)declare it under the Variables element. 



Loop © 


Description: 


A portion of the dialog that should be executed several times. 


Notes: 


Hie Loop element is created by right-clicking on the Package icon on the Dialogs window 
(LHS). Variables are freely shared between the Loop body and the main dialog (of the same 
Package) as they are in one VoiceXML document. 

See Chapter 9: Advanced Techniques for more information 


Parameters: 


Loop 

Name: a name for this Loop element. 

Loop Test: an ECMAScript expression that if evaluated to true will cause execution of the 
next iteration of the loop, eg. counter < 5. 

Test at start: If enabled, the test condition is evaluated at the start of the loop and the loop is 
equivalent to a while / for loop. If disabled, the loop body is executed before the test 
condition is evaluated and the loop is equivalent to a do-while loop. 

Exit message: a message to be played when the loop exits normally, eg. there are no more 
items. The system can generate a default text prompt and a default audio file name for 
recording the corresponding audio prompt, or you may enter in your own values. If a 
message is not required, the "Generate default..." checkboxes should be unchecked and the 
"Audio file" and "TTS" text boxes should be left empty. 

Loop Init 

Variables to be initialised at the start of the loop. 

Name: name of a variable, eg. counter. The variable must have been created elsewhere, such 
as in the Variables element. 

Value: an ECMAScript expression that sets the initial value for the variable, eg. 0. 
Loop Step 

Variables to be incremented before another iteration of the loop. The increment occurs 
before the test condition is reevaluated. 

Name: name of a variable, eg. counter. 

Value: an ECMAScript expression to increment the variable, eg. counter + 1. 
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APPENDIX B: TWO EXTENDED VoiceXML files OF AN APPLICATION 

FILE 1. DEM02 8MAY.VXML 

<?xml version^ " 1 . 0" encoding="utf -8 " ?> 

<vxml version="l . 0" xmlns : lq="http : //www. telstra . com.au/LyreQuest"> 
5 <link event="help"> 

<grammar src="null#Help"/> 
</link> 

<link event= "repeat "> 
10 <grammar src= "null#Repeat "/> 

</link> 

<link event="quit"> 

<grammar src= n null#Quit "/> 
15 </link> 

<script> 

function merge (objl, ob j 2 ) 

{ 

20 if (objl == undefined) 

return obj2; 

else 

return objl; 

} 

25 </script> 

<var name= n _dummy"/> 

<var name="counter" lq : element= "DocumentVariables " / > 

30 

<catch event="quit "> 

<prompt counts" 1" bargein= n true" lq:text=""> 

<value expr= " PromptGoodbye ( ) " / > 
< /prompt > 
35 <exit/> 
</catch> 

<catch event="noinput "> 

<prompt count="l" bargein= " true" lq: texts" " > 
40 <value expr="PromptNoinput () "/> 

< /prompt > 

<reprompt/> 
</catch> 

45 <catch event= n nomatch"> 

<prompt count="l" bargein=" true" lq:text=""> 
<value expr="PromptNomatch ( ) "/> 

< /prompt > 

<reprompt/> 
50 </catch> 

<form id="DIALOG_MainDialog" lq : elements "StartDialog" 
lq : name= " MainDialog " > 



WO 2004/010678 



PCT/AU2003/000939 



-29- 



<block name="link"> 

<goto next="#SPEAKER_sayWelcome"/> 
</block> 

5 </form> 

<form id="SPEAKER_sayWelcome" Iq : element= "Speaker" 
lq : name= " sayWelcome " > 
<block> 

10 <prompt> 

Welcome to the automated X Y Z bank 
< /prompt > 
</block> 

<block name="link n > 
15 <goto next= M #LOOPCALL_call_authenticate__loop"/> 

</block> 

</ f orm> 

20 <f orm id="LOOPCALL_call_authenticate_loop" lq : element = "LoopCall " 

lq: name= "call_authenticate_loop" lq: call s = " authenticate" > 

<subdialog name="loopcall " src= "#LOOP_authenticate" > 
<param name= "counter " expr= "document . counter " /> 
<param name= "get__PIN" expr= "document . get_PIN" /> 
25 <param name= "validatePIN" expr= "document . validatePIN" / > 

<param name= "call__get_balance" 
expr=" document . call_get_balance" /> 

<param name= "payment_detail3 " 
expr= "document . payment_details "/> 
30 <filled> 

<assign name= " document . counter" 
expr=" loopcall . counter"/> 

<assign name = "document . get_PIN" 
expr=" loopcall ,get_PIN"/ > 
35 <assign name= "document . validatePIN" 

expr= " loopcall . validatePIN " / > 

<assign name= "document . call_get_balance" 
expr=" loopcall . call_get_balance" / > 

<assign name=" document . payment_jie tails " 
40 expr= " loopcal 1 . payment_de tai 1 s " / > 

</filled> 
</subdialog> 
<block name="link"> 

<goto next= " #DECISION__checkPINvalidity " / > 
45 ' </block> 

</form> 

<form id="DECISION__checkPINvalidity n lq : element^ "Decision" 
50 lq : name= "checkPINvalidi ty " > 
<block> 

<if cond="validatePIN.x == &apos; PASS&apos ; "> 

<goto next= "#BRANCH_checkPINvalidity_0 " /> 
<else/> 

55 <goto next= H #BRANCH_checkPINvalidity_l"/> 

</if> 
</block> 
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</f orm> 

<form id="BRANCH_checkPINvalidity_0" lq: element^ "Branch" 
lq:condition="validatePIN.x == &apos ; PASS&apos ; " > 
<block name= n link"> 

<goto next="#MENU_jnain''/> 

</block> 
</f orm> 



<menu id= "MENU_main" lq: element = "Menu" lq:name="main"> 
<prompt count="l" bargein= " true" lq : text= 11 " > 

<value expr= " PromptMenu_main ( ) " / > 
</ prompt > 

15 <choice next="#MENUITEM_main_balance"> 

<grammar . src="null#Menu_main_balance" / > 
</choice> 

<choice next="#MENUITEM_main_enquiry"> 

<grammar src= "null#Menu_main_enquiry » /> 

20 </choice> 

<choice next= M #MENUITEM_main_leave_message n > 

<grammar src== u null#Menu_main_leave_message" / > 
</choice> 

<choice next- " #MENUITEM_ma'in_pay_bills " > 
2S <grammar src= "null#Menu__main_pay_bills " /> 

</choice> 

<choice next="#MENUITEM_main_quit"> 

<grammar src= "nul l#Menu_main_quit 11 / > 
</choice> 

30 

<catch event="help ,! > 

<prompt count="l" bargein= M true" lq:text=*'"> 
<value expr="PromptHelpJ4enu_main() '•/> 
</prompt> 
35 </catch> 

<catch event=" repeat "> 

<reprompt/> 
</catch> 
</menu> 

40 

<form id="MENUITEM_main_balance" lq : element="MenuChoice" 
lq : name = "balance " > 

<block name="link"> 

<goto next="#SUBROUTINECALI J _call_get_balance"/> 

45 </block> 
</ f orm> 

<var name="call_get_balance" expr="new ObjectO" 
50 lq : ref erences = " call__get__balance " / > 

<form id="SUBROUTINECALL_call_get_balance" 
lq : element= " SubroutineCall " lq : name= " call_get_balance " 
lq : calls= " subroutinel . vxml#subjpres en t_ba lance " > 
<subdialog name="subcall " 
55 src= " subroutinel . vxml#SUBROUTINE_sub _present_balance " > 

<param name="pin_number n expr= "get_PIN . PIN" 
lq : e lement- » Input "/ > 
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<f illed> 

<assign name=" callage t__balance . result__code" 
expr= "subcall . resul t_code" lq : element = "Output "/ > 
</filled> 
5 </subdialog> 

<block name="link"> 

<goto next = " #SPEAKER_Speaker2 4 » / > 
</block> 

10 </form> 

<form id="SPEAKER_Speaker2 4" lq: element =" Speaker" 
lq:name="Speaker24"> 
<block> 

15 <prompt> 

the result of your balance enquiry is 
<value expr='"call_get_balance . result_code"/> 
< /prompt > 
</block> 

20 <block lq:element="Goto" lq : next="main"> 

<goto next="#MENU_main"/> 
</block> 



25 



</f orm> 



<f orm id= M MENUITEM_main_enquiry" lq : element= "MenuChoice " 
lq : name= "enquiry" > 

<block name="link"> 

<goto next="#SPEAKER_Speaker21"/> 
30 </biock> 

</form> 

<f orm id="SPEAKERJ3peaker21" lq : element^ "Speaker" 
35 lq:name="Speaker21" > 
<block> 

<prompt> 

you are being transfered to an operator 
< /prompt > 
40 , </block> 

<block name="link" > 

<goto next= " #TRANSFERJTransf er2 2 » / > 
</block> 

45 </form> 

<f orm id="TRANSFER_Transf er22" lq : element= "Transfer " 
lq:name="Transf er22" lq:bridge=" false" lq: destinations " 03 9253 6742" 
lq : dest inationExpression= "null " lq : connectTimeout= " 3 0 " > 
50 <transfer name= "Transf er22 " bridge="f alse" 

connecttimeout="30s" dest= " 0392536742 " > 
</transf er> 
</f orm> 

55 <f orm id= "MENUITEM_main_leave_message " lq : element= "MenuChoice ' 

lq:name=" leave message "> 

<block name=" link" > 
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<goto next="#RECORP_Record2 0"/> 
</block> 

</ f orm> 

5 

<var name = "Record2 0 11 lq : ref erences= M Record2 0 " /> 

<form id="RECORD_Record2 0 " lq : element= "Record" lq : name= M Record20 " 
lq:beep=" true" lq: duration= H 3 0 " lq: dtmf Terminate= "true" 
lq:mimeType="null" lq : conf irm= " true " > 
10 <record name= M record_Record2 0 " beep="true" maxtime=" 3 0s " 

dtmf t erm= " t rue " > 

<prompt count="l" bargein= " true " lq:text="at the tone, 
please record your message, you can press hash to end."> 

<value expr="PromptRecord_Record20 () "/> 
15 </prompt> 
</record> 

<field name= " conf irm" modal= " true " > 
<grammar src="null#Conf irm"/> 
<prompt> 

Your recording is <value expr= "record_Record2 0 " /> 
To keep it, say yes. To discard it, say no. 
< /prompt > 
<f illed> 

<if cond=" conf irm != 'yes 1M > 
<clear/ > 

</if > 
</f illed> 

<catch event="help"> 
<prompt> 

Please say yes to keep your recording, or 
say no to record another message. 

< /prompt > 
</catch> 

<catch event="repeat"> 
<prompt> 

Your recording is <value 
expr="record_Record2 0"/> To keep it, say yes. To discard it, say no. 

< /prompt > 
</catch> 
</f ield> 

<block> 

<assign name="Record2 0 " expr="record_Record2 0"/> 
45 </block> 



25 



30 



35 



<block lq:element="Goto" lq : next= "main" > 

<goto next= M #MENU_main"/> 
</block> 

50 

</f orm> 



<form id="MENUITEM_main_pay_bills" lq : element="MenuChoice " 
lq:name="pay bills"> 
55 <block name= n link" > 

<goto next="ttFORM_payment_details"/> 
</block> 
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</form> 

<var name="payment_details" expr= "new Obj ect ( ) " 
lq : ref erences = "payTnent_details M /> 

<form id="FORM_j>ayment__de tails" lq : element="Form" 
lq : name= "payment_detai Is " lq : modal = " false " lq : conf irm= " true " 
lq : documentGrammar= "true " > 

<grammar scope= "document " src= "null #Form_payment_de tails "/ > 



<field name=" company" cond=" false" /> 
<field name= "amount " cond=" false" /> 
<field name="payment_date " cond="f alse " /> 

<block> 

15 <assign name= "payment__detai Is . company" expr=" company "/> 

<assign name = "payment_details . amount " expr= "amount "/ > 
<assign name= "payment_de tails . payment_date " 
expr= "payTnent_date "/ > 
</block> 

20 <subdialog name = "payment_de tail s_company" 

src= " #ASK_payment_details_company " > 

<param name="payment_details" expr= "payment_details " /> 
<f illed> 

<assign name= "payment_details " 
25 expr= ,, payment_detaiis_company . payment_details " / > 

</f illed> 
</subdialog> 

<subdialog name= "payment_details_amount " 
30 src= " #ASK_payment__details_amount " > 

<param name ="payment_de tails " expr= "payment_details " /> 
<f illed> 

<assign name= "payment_details " 
expr= "payment_details_amount .payment_de tails "/> 
35 </filled> 
</subdialog> 

<block> 

<if cond="payment_details , payment__date == undefined" > 
40 *;script> 

<! [CDATA [ 

payment_de tails . payment_date = new 



Object () ; 
45 = ' today ' ; 

50 



payment_details . payment_date .modifier 



]]> 

</ script> 

</if> 
</block> 



<subdialog name= "payment_details_payment_date " 
src="#ASK __payment_details_payment_date"> 

<param name= "payment_details " expr="payment_details"/> 
<f illed> 

55 <assign name= "payment_details " 

expr= "payment_details_payment_date . payment_details "/> 
</filled> 
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</subdialog> 

<field name= n conf irm M > 

<grammar src="null#Conf irm"/> 
5 <prompt> 

<value 

expr="PromptConf irm_j)ayment_de tails (payment_de tails . company, 
payment_de tails . amount, payment_de tails . payment_date ) "/> 
< /prompt > 
10 <filled> 

<if cond=" confirm != 'yes ,M > 

<assign name= "payment_details . company" 

expr="undef ined"/> 

<assign name="payment_de tails . amount" 

15 expr= "undef ined"/> 

<assign name=="payment_details . payment_date " 

expr= "undefined"/ > 

<clear/> 

</if> 

20 </filled> 

<catch event= "help" > 
<prompt> 

<value 

expr="PromptHelp_Conf irm_payment_de tails () "/> 
25 </prompt> 

</catch> 

<catch event="repeat " > 

<reprompt/ > 
</catch> 

30 

</field> 

<block lq:element="Goto" lq : next= "main" > 

<goto next="#MENU_main"/> 
</block> 

35 

</form> 

<form id="ASK_payment_details_company" lq : element= " FormField" 
lq: ref erences="payment_details" lq:name=" company" lq : type="bpay_names" 
40 lq:default=" " lq : conf irm=" false" > 

<grammar src= "null #Ask_payment_de tail s_company"/> 

<var name="payment_details"/> 

<block> 

<if cond="payment_de tails . company != undefined" > 
<return namelist= "payment jie tails " /> 

</if> 
</block> 

<field name = " company" cond=" false" /> 
<field name="amount " cond="f alse" /> 
<field name="payment_date" cond="f alse"/> 
<initial name= "start " > 

<prompt count="l" bargein="true" lq : text= "please say 

the company" > 
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<value 

expr= "Prompt As k_jpayment_details_company ( ) "/> 
</prompt> 
</initial> 
5 <filled mode="any"> 

<assign name= "payment__de tails . company" 
expr="merge (payment_details . company , company) "/> 

<assign name = "payment_details . amount " 
expr=" merge (payment_de tails .amount, amount) "/ > 
10 - ~ <assign name= "payment_de tails .payment_date" 

expr= "merge (payment_de tails .payment_date , payment_date) "/ > 

<if cond="payment_details .company ■» undefined"> 
<clear/> 

</if> 

15 </filled> 



20 



35 



40 



<block> 

<return namelist^ "payment_details " / > 
</block> 



<catch event="help" > 

<prompt count="l" bargein= " true " lq : text = "please say 

the company. "> 
25 <value 

expr="PromptHelp_Askjpayment_details_company () "/> 
</prompt> 
</catch> 

30 <catch event= "repeat "> 

<reprompt/> 
</catch> 



</f orm> 



<form id="ASKjpayment_details - amount". lq : element^ "FormField" 
lq : ref erences= "payment_details " lq : name= " amount « lq : type= "Money" 
lq:default = " [] " lq:conf irm="false"> 

<grammar src= "null#Askjpayment_details_amount "/> 

<var name="payment__details"/> 



<block> 

<if cond= M payment_de tails .amount != undefined" > 
45 <return namelist= "payment_de tails "/> 

</if> 
</block> 

<field name=" amount" cond= " f alse"/> 
50 <field name="payment_date" cond="f alse "/> 

<initial name="start " > 

<prompt counts "1" bargein="true" lq:text=""> 
<value 

expr="PromptAskjpayment_details_amount 0 "/> 
55 < /prompt > 

</ initial> 
<filled mode="any"> 
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<assign name = "payment_det ails . amount" 
expr= "merge (payment_details. amount, amount) »/> 

<assign name="payment_de tails . payment__date 11 
expr= "merge (payment_details . payment_date , payment__date) "/> 
5 <if cond="payment_de tails .amount — undefined" > 

<clear/> 

</if > 
</filled> 

10 <block> 

<return namel is t= "payment_de tails " / > 
</block> 



15 <catch event="help"> 

<prompt count =" 1" bargein=" true" lq:text=""> 
<value 

expr="PromptHelp_Ask_payment_details__amourit 0 "/> 
< /prompt > 
20 </catch> 

<catch event=" repeat "> 

<reprompt/> 
</catch> 



25 



</f orm> 



<f orm id="ASK_payment_details_payment_date" lq: element="FormField" 
lq : ref erences="payment_details" lq : name="pa^ent_date" lq : type="Date" 
30 lq:default=" [ {modifier^ 1 today ' }] " lq : conf irm=" true" > 

<grammar src = "null#Ask_payment_details__payment_date ,, /> 

<var name="payment_details"/> 

35 <block> 

<if cond="payment_de tails . payment_date != undefined" > 
<assign name=" start" expr="true" /> 
<goto nextitem= "confirm" /> 

</if> 

40 </block> 

<field name="payment_date" cond="f alse"/> 
<initial name="start"> 

<prompt counts" 1" bargein=" true" lq:text=""> 
45 <value 

expr="PromptAsk__payment_detailsjpayment_date () "/> 
< /prompt > 
</initial> 
<filled mode="any"> 
50 <assign name="payment_de tails .payment_date" 

expr= "merge (payment_de tails ,payment_date, payment_date) " /> 

<if cond="payment_details .payment_date == undefined" > 
<clear/ > 

</if> 

55 </filled> 



<field name="conf irm" > 
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<grammar src="null#Conf irm"/> 
<prompt> 

<value 

expr = 11 Prompt Conf irmjoayment_de tail s_j?ayment_date (payment_de tails . payment_ 
5 date) "/> 

</prompt> 
<filled> 

<if cond=" confirm == ' yes'"> 

<return namelist= "payment_de tails " / > 
10 <else/> 

<assign name= "payment_details . payment_date M 

expr="undef ined" /> 

<clear/ > 

</if> 

15 </filled> 

<catch event="help" > 
<prompt> 

<value 

expr="PromptHelp_Conf irm_payment_details_payment_date () "/> 
20 </prompt> 

</catch> 
. <catch event=" repeat" > 

<reprompt/> 
</catch> 



25 



40 



</f ield> 



<catch event="help" > 

<prompt count="l" bargein=" true" lq:text=" "> 
30 <value 

expr="Pro'mptHelp_Ask_payment_details_j)ayment_date {) "/> 
< /prompt > 
</catch> 

35 <catch event= " repeat "> 

<reprompt/> 
</catch> 



</f orm> 



<form id="MENUITEM_main_quit" lq : element="MenuChoice" 
lq:name="quit"> 

<block lq : element="End" > 
<exit/> 
45 </block> 

</f orm> 

<f orm id= "BRANCH_checkPINvalidity_l " lq : element= "Branch" 
50 lq : condition^ "otherwise "> 

<block name="link"> 

<goto next= " #S PEAKER_f ai ledPIN" / > 
</block> 

55 </form> 
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<f orm id="SPEAKER_failedPIN" lq:element=" Speaker" 
lq : name = 11 f ailedPIN" > 
<block> 

<prompt> 

5 You have not been authenticated. Goodbye. 

< /prompt > 
</block> 

<block lq: element="End"> 
<exit/> 
10 </block> 

</f orm> 

<form id= n LOOP_authenticate" lq : element= " Loop " 
15 lq:name="authenticate" lq: testatstart=" true"> 

<var name="counter l 7> 

<var name= n get_PIN" /> 

<var name="validatePIN"/> 

<var name=" callage t_balance"/> 
20 <var name="payment_details"/> 

<block> 

<assign name= "document . counter " expr= " counter " / > 
<assign name= "document . get_PIN" expr="get_PIN"/> 
<assign name= "document . validatePIN" 
25 expr= "validatePIN" / > 

<assign name= "document . call_get_balance" 
expr= "call__get_balance" / > 

<assign name = "document . payment_details " 
expr= "payment_detai 1 s " / > 
30 </block> 
<block> 

<goto next= M #LOOPINIT__authenticate"/> 
</block> 

35 </form> 

<form id="LOOPINIT_authenticate" lq : ref erences="authenticate " > ■ 
<block> 

<assign name=" counter" expr="0" lq : element="LoopInit " /> 
40 <goto next« M #LOOPTEST_authenticate"/> 

</block> 
</form> 

<form id="LOOPTEST_authenticate" lq : element= "LoopTest " 
45 lq: test="counter&lt ; 3" lq: ref erences= "authenticate "> 
<block> 

<if cond= " counter < 3" > 

<goto next= " #LOOPBODY_authent icate " / > 
<else/> 

50. <goto next="#LOOPEND_authenticate"/> 

</if> 
</block> 

</ f orm> 

55 

<form id="LOOPEND_authent icate" lq : element="IjoopEnd" 
lq : ref erences= "authenticate" > 
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<block> 

<prompt count ="1" bargein="true" lq: text= ,! "> 

<value expr= " PromptLoopExit_authenticate ( ) " / > 
< /prompt > 

5 <return namelist=" counter get_PIN validatePIN 

call_get_balance payment_details "/> 
</block> 
</form> 

10 <f orm id="LOOPSTEP_authent icate" lq : ref erences=" authenticate " > 

<block> 

<assign name=" counter" expr=" counter* 1" 
lq : element = " LoopStep" / > 

<goto next= " #LOOPTEST_authent icate " / > 
15 </block> 
</form> 

<form id="LOOPBODY_authent icate" lq : element= "LoopBody" 
lq : ref erences= 11 authenticate " > 
20 <block name=" link" > 

<goto next="#FORM_get_PIN"/> 
</block> 



25 



40 



;/f orm> 



<var name="get_PIN" expr="new Object ()" lq : ref erences="get_PIN"/ 
<form id="FORM_get_PIN" lq : element^ " Form" lq : name= "get__PIN" 
lq : modal= "true " lq : conf irm= " false" lq : documentGrammar= " false " > 
<field name="PIN" cond="f alse " /> 
30 . <block> 

<assign name= M get_PIN . PIN" expr="PIN"/> 
</block> 

<subdialog name="get_PIN_PIN n src= "#ASK_get__PIN_PIN" > 
<param name="get_PIN" expr="get_PIN"/> 
35 <filled> 

<assign name="get_PIN" 
expr= " get_PIN_PIN . get_PIN" / > 
</filled> 
</subdialog> 



<block name="link"> 

<goto next="#REMOTE_validatePIN"/> 
</block> 



45 </form> 

<form id="ASK_get_PIN_PIN" lq : element="FormField n 
lq : ref erences="get_PIN" lq:name="PIN" lq : type= "Digitstring" lq:default 
lq: conf irm=" false "> 
50 <var name="get__PIN"/> 

<block> 

<if cond="get_PIN. PIN != undefined" > 
<return namelist= "get_PIN"/> 

55 </if> 
</block> 
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<field name="PIN"- modal = "true " > 
<link event ="help"> 

<grammar src="null#Help ,r /> 
</link> 

5 <link event= "repeat "> 

<grammar src= u null#Repeat n /> 
</link> 

<grammar src="null#Ask_get__PIN_PIN"/> 
<prompt count="l" bargein=" true" lq : text="please say 
10 your four digit PIN number" > 

<value expr= "Prompt As k_get_PIN_P IN ( ) "/> 
</prompt > 

<prompt count="2" bargein=" true" lq : text=" second 
prompt, please say the pin. Example is one two three four."> 
15 <value expr =" Prompt As k_ge t_P INJP IN_2 () "/> 

< /prompt > 
<filled> 

<assign name= "get_PIN . PIN" 
expr= "merge (get_PIN. PIN, PIN) "/> 
20 </filled> 
</f ield> 

<block> 

<return namelis t= "get_PIN" / > 
25 </block> 



<catch event="help"> 

<prompt counts"!" bargein= 11 true 11 lq:text-"" > 
30 <value expr="PromptHelp_Ask_get_PIN_PIN() "/> 

< /prompt > 
</catch> 

<catch event= " repeat " > 
35 <reprompt/> 
</catch> 

</ f orm> 

40 <var name="validatePIN" expr="new Object ()" 

lq: refer ences="validatePIN"/> 

<form id="REMOTE_validatePIN M lq: element= H RemoteProcessing" 
lq :name="validatePIN" 

lq: src="http : //videre . trl . telstra. com.au/-c797808/cgi~ 
45 bin/verif y_pin . php " > 

<var name="sendingjpam" expr="get_PIN. PIN" 
lq : el ement = " Input " / > 

<subdialog name="remotecall" 
src= "http:/ /videre. trl. telstra. com.au/~c7 978 0 8/cgi-bin/verify_j)in. php" 
50 namelist="sending_pam "> 

<filled> 

<assign name="validatePIN.x" expr="remotecall . x" 
lq : elements "Output"/> 

</filled> 
55 </subdialog> 

<block name= M link"> 

<goto next="#DECISIONj>assOrFail"/> 
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</block> 
</f orm> 

5 <form id="DECISIONjpassOrFail" lq : element= "Decision" 

lq : name= "passOrFail " > 
<block> 

<if cond= " validatePIN. x == &apos ; PASS&apos; " > 

<goto next="#BRANCHj?assOrFail_0"/> 
10 <else/> 

<goto next="#BRANCHj>assOrFail_l"/> 

</if> 
</block> 
</f orm> 

15 

<f orm id= "BRANCH_j)assOrFail__0 " lq : element^ "Branch" 
lq : condit ion= " validatePIN . x == &apos ; PASS&apos ; " > 
<block lq: element= "Break" > 

<return namelist= "counter get_PIN validatePIN 
20 callage t_balance payment_details "/> 
</block> 

</f orm> 

25 1 <form id= "BRANCH_passOrFail_l " lq : element= "Branch" 

lq: condition="otherwise" > 

<block name="link" > 

<goto next="#SPEAKER_tryAgain"/> 
</block> 



30 



</f orm> 



<form id="SPEAKER_tryAgain" lq : element^ "Speaker " 
lq : name= " tryAgain" > 
35 <block> 

<prompt> 

Your PIN is not valid. Please try again. 
< /prompt > 
</block> 

40 <block lq:element="Next M > 

<goto next= "#LOOPSTEP_authent icate " / > 
</block> 



45 



</f orm> 
< / vxml > 
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FILE 2. SUBROUTINE!. VXML 



<?xml version=" 1 . 0 " encoding="utf -8 " ?> 
5 <vxml vers ion=" 1.0" xmlns : lq="http : //www. telstra.com. au/LyreQuest " > 
<link event = "help "> 

<grammar src= "null#Help"/> 
</link> 

10 <link event= "repeat 11 > 

<grammar src= "null#Repeat "/> 
</link> 

<link event= "quit " > 
15 <grammar src= "null#Quit " / > 

</link> 

<script> 

function merge {objl, obj2) 
20 { 

if (objl == undefined) 
return obj2; 

else 

return objl; 

25 } 

</ script> 

<var name="_dummy"/> 

30 <var name = 11 cus tomer_balance " lq : element= "DocumentVariables " / > 

<var name= ,, pin_number" lq : ref erences="sub_present_balance " /> 
<var name="result_code" lq:"ref erences = " sub_present_balance "/> 
<f orm id= "SUBROUTINE_sub_pres en t_ba lance " lq : element= "Subroutine 
35 lq : name= " sub_pres ent_balance " > 

<var name="pin_number " lq : element^ " Input "/> 
<var name="result_code" lq: element =" Output "/> 
<block> 

<assign name= "document .pin_number" expr= "pin__number" 
40 <assign name =" document . re sult_code" 

expr= " resul t_code " /> 
</block> 

<block name="link M > 

<goto next= n #F0RM_Form4"/> 
45 </block> 

</form> 

<var name="Form4" expr="new ObjectO" lq : ref erences= "Form4 "/> 
50 <form id="FORM__Form4" lq : element = "Form" lq:name="Form4" 

lq:modal=" false" lq: conf iritis" true" lq : documentGrammar= "false" > 
<field name="account_number n cond= "false"/ > 
<block> 

<assign name= "Form4 . account_number 11 
55 expr= "account_number"/> 
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10 



</block> 

<subdialog name="Form4_account_number n 
src= " #ASK_Form4_account_number " > 

<param name= "Form4 " expr="Form4"/> 
<filled> 

< as sign name="Form4" 
expr= " Form4_account_number . Form4 " / > 
</f illed> 
</subdialog> 



<field name= ,, confirm"> 

<grammar src="null#Conf irm"/> 
<prompt> 

<value 

15 expr= " Prompt Conf irm_Form4 {Form4 . account_nuraber) "/> 

</prompt> 
<filled> 

<if cond=" confirm != 'yes'" > 

<assign name= "Form4 . account_number " 

20 expr="undef ined" /> 

<clear/> 

</if> 
</filled> 

<catch event= "help" > 
25 . <prompt> 

<value expr = "Prompt He lp_Conf irm_Form4 () 
< /prompt > 
</catch> 

<catch event=" repeat "> 
30 <reprompt/> 

</catch> 

</field> 

<block name ="1 ink " > 
35 <goto next="#LOCAL_JL.ocalProcessing5"/> 

</block> 

</f orm> 

40 <form id= n ASK_Form4_account_riumber" lq : element- "FormField" 

lq:ref erences= "Form4 " lq:name="account_number" lq : type= "Digit string" 
lq:def ault=" " lq: conf irm=" false " > 

<grammar src="null#Ask_Form4_account_number "/> 

45 <var name="Form4" /> 

<block> 

<if cond="Form4 . accoimt_number ! = undefined"> 
<return namelist="Form4 "/> 

50 </if> 
</block> 

<field name="account_number" cond="f alse "/> 
<initial name= "start " > 
55 <prompt count="l" barge in=" true" lq:text=" "> 

<value expr= " Prompt Ask_Form4_account_number ( ) 
</prompt> 
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</initial> 

<filled mode="any M > 

<assign name= " Form4 . account_number " 
expr="merge (Form4 . account__number , account_number) "/> 
5 <if cond="Form4 . account__number == undefined"> 

<clear/> 

</if> 
</filled> 

10 <block> 

<return namelist= u Form4"/> 
</block> 

15 <catch event =" he lp"> 

<prompt count="l" bargein*" true" lq:text= M,, > 
<value 

expr= " PromptHelp_Ask_Form4_account_number ( ) " / > 
< /prompt > 
20 </catch> 

<catch event= "repeat "> 

<reprompt/> 
</catch> 

25 

</f orm> 

<form id= n LOCAL_LocalProcessing5" lq : element = "LocalProces sing" 
lq : natne= "LocalProcessingS " > 
30 <block> 

<script> 

< ! [CDATA[customer_balance = new Object (); 
if (Form4 . account_number » 12 ' ) { 

customer_balance .dollars = '1000'; 
35 customer_balance. cents = '50*; 

} else { 

customer_balance. dollars = 1 0 ' ; 
customer_balance . cents = ' 2 ' ; 

40 result_code = pin_number + 1;]]>' 

</script> 
</block> 

<block name="link"> 
45 <goto next="#SPEAKER_Speaker6"/> 

</block> 

</f orm> 

50 <form id="SPEAKER_Speaker6" lq : element=" Speaker " 

lq : name= " Speaker6 " > 
<block> 

<prompt> 

your balance is 

55 <value expr="PromptMoney (customer_balance) "/> 

< /prompt > 
</block> 
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<block lq: element^ "Return" > 

<return namelist= n result_code "/> 
</block> 

5 </form> 



</vxml> 
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APPENDIX C: PORTION OF A SYSTEM GENERATED VoiceXML FILE 



FILE 1. DEM02 8MAY.VXML (INCOMPLETE, FOR EXAMPLE ONLY) 

<?xml version="l . 0" encoding="utf -8 " ?> 
5 <!DOCTYPE vxml PUBLIC "-//Nuance/DTD VoiceXML 1.2/EN" 
"http : //voicexml .nuance . com/dtd/nuancevoicexml-1-2 . dtd"> 
<vxml v versions 11 1 . 0 M applications "demo2_8may . vxml " > 
<link event="help n > 

<grammar src= N demo2_8may . gsl#Help " /> 
10 </link> 

<link events "repeat " > 

<grammar src= "demo2_8may . gsl#Repeat "/> 
</link> 

<link event="quit"> 

<grammar src= "demo 2 _8 may . gs l#Qui t " / > 
</link> 

<script> 

function merge (objl, obj2) 

{ 

if (objl == undefined) 
return ob j 2 ; 

else 

return objl; 

} 

</script> 

30 <var name="_dummy" /> 

<var name= "counter" /> 

<catch event="guit " > 

<prompt count="l" bargein= " true " > 

<value expr= " PromptGoodbye { ) "/> 
< /prompt > 
<exit/> 
</catch> 

<catch events "noinput "> 

<prompt count=" 1" bargein="true" > 

<value expr= "PromptNo input ( ) "/> 
< /prompt > 
<reprompt/> 
</catch> 

<catch events "nomatch"> 

<prompt count ="1" bargein="true M > 
50 <value expr=" PromptNomatch ( ) "/> 

</prompt> 
. <reprompt/> 



20 



25 



35 



40 



45 
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</catch> 

<form id= n DIALOG_MainDialog"> 
<block name =" 1 ink" > 
5 <goto next="#SPEAKER_sayWelcome"/> 

</block> 



</f orm> 

10 <form id="SPEAKER_sayWelcome" > 

<block> 

<prompt> 

Welcome to the automated X Y Z bank 
</prompt> 
15 </block> 

<block name = fl link"> 

<goto next="#LOOPCALL_call_authenticate_loop n /> 
< /block> 



20 </form> 

<form id="LOOPCALL_call_authenticate_loop"> 

< subdialog name= " loopcall " src = " #LOOP_authent icate " > 
<param name= "counter " expr= "document . counter "/ > 
25 <param name= "get_PIN" expr= "document . get_PIN" / > 

<param name= "validatePIN" expr= "document .validatePIN" /> 
<param name = "call_get__balance" 
expr= "document . call_get_balance "/ > 

<param name= "payment__details" 
30 expr=" document .payment_de tails " /> 

<filled> 

<assign name= " document . counter " 
expr=" loopcall .counter"/ > 

<assign name= "document . get_PIN" 
35 expr="loopcall .get_PIN"/> 

<assign name= "document .validatePIN" 
expr=" loopcall . validatePIN"/> 

<assign name=" document . call_get_balance" 
expr= " loopcal 1 . call_get_balance " / > 
40 <assign name=" document . payment__de tails " 

expr=" loopcall . payment_de tails " /> 
</filled> 
</subdialog> 
<block name="link"> 
45 <goto next="#DECISION_checkPINvalidity"/> 

</block> 

</ form> 



50 <form id="DECISION_checkPINvalidity"> 

<block> 

<if cond="validatePIN.x == &apos ; PASS&apos ; " > 

<goto next= " #BRANCH_checkPINvalidi tyj) " / > 
<else/> 

55 <goto next="#BRANCH_checkPINvalidity_l"/> 

</if> 
. </block> 
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</f orm> 

<form id^"BRANCH_checkPINvalidity_0 M > 
<block name= n link"> 
5 <goto next = n #MENUjnain'7> 

</block> 

</form> 

10 <menu id= "MENUjnain 11 > 

<prompt count= M l" bargein=" true" > 

<value expr= " Prompt Me nu^ma in ( ) " / > 
</prompt> 

<choice next= " #MENUITEM_main_balance " > 
15 <grammar src= "demo2_8may . gsl#Menu_main_balance"/> 

< / choice> 

<choice next="#MENUITEM_main_enquiry M > 

<grammar src= " demo2_8may . gsl#Menu_main_enquiry " / > 
< / choice> 

20 <choice next="#MENXJITEM__main_leave_message"> 

<grammar src= "demo2_8may . gsl#Menu_main_leave_message ' 

</choice> 

< choice next = n #MENUITEM_mainjay_bi lis" > 

<grammar src= M demo2_8may . gsl#Menu_main_pay_bills " / > 
25 </choice> 

<choice n ex t = " # MENU I TEM_ma i n_qu i t " > 

<grammar src= "demo2_8may . gsl#Menu_main_qui t 11 / > 

</choice> 

30 <catch event= "help" > 

<prompt count=" 1" bargein=" true " > 

<value expr= M PromptHelp_Menu_main ( ) "/> 
</prompt> 
</catch> 

35 <catch event= M repeat"> 

<reprompt/ > 
</catch> 
</menu> 

40 <form id="MENUITEM_main_balance"> 

<block name="link" > 

<goto next= 11 #SUBROUTINECALL_cal l_get_balance " / > 
</block> 

45 </form> 

<var name= "call_get_balance " expr="new Object ()"/> 
<f orm id= »SUBROUTINECALL_call_get_balance " > 
<subdialog name="subcall " 
50 src= " subroutinel . vxml#SUBROUTlNE_sub_present_balance " > 

<param name="pin_number " expr="get_PIN . PIN"/> 
<filled> 

<assign name= "callage t_balance . re sult_code M 
expr="subcall . result_code"/> 
55 </filled> 
</subdialog> 
<block name="link"> 
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<goto next="#SPEAKER_Speaker24«'/> . 
</block> 

</form> 

5 

<form id="SPEAKERj5peaker24"> 
<block> 

<prompt> 

the result of your balance enquiry is 
10 <value expr="call_get_balance . result_code"/> 

< /prompt > 
</block> 
<block> 

<goto next="#MENU_main"/> 
15 </block> 

</f orm> 

< f orm id= " MENUITEM_main_enquiry " > 
20 <block name="link"> 

<goto next= " #SPEAKER_Speaker2 1 11 / > 
</block> 



25 



35 



50 



</f orm> 



<form id= n SPEAKER_Speaker21"> 
<block> 

<prompt > 

you are being transfered to an operator 
30 </prompt> 
</block> 

<block name="link"> 

<goto next= M #TRANSFER_Transfer22"/> 
</block> 



</ f orm> 



<form id="TRANSFER_Transfer22"> 

<transfer name = "Transfer 2 2 " bridge="f alse" 
40 connecttimeout=»30«' destexpr=" « tel : 0392536742 '»> 

</transf er> 
</form> 

<f orm id="MENUITEM_main_leave_message n > 
45 <block name= M link"> 

<goto' next= " #RECORD_Record2 0 " / > 
</block> 



c/f orm> 



<var name="Record2 0 "/> 
<form id= n REC0RD_Record20"> 

<record name="reco'rd_Record2 0" beep="true" maxtime="30s " 
dtmf term= M true "> 
55 <prompt count = VI" bargein="true"> 

<value expr="PromptRecord_Record20 () »/> 
< /prompt > 
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</record> 

<field name= "confirm" modal="true" > 

<grammar src="demo2_8may .gs 1# Confirm" /> 
5 <prompt> 

Your recording is <value expr="record_Record20 "/ 
To keep it, say yes. To discard it, say no. 
< /prompt > 
<filled> 

10 <if cond="conf irm != 'yes'"> 

<clear/> 

</if> 
</filled> 

<catch event =" help "> 
15 <prompt> 

Please say yes to keep your recording, or 
say no to record another message. 

< /prompt > 
</catch> 

20 <catch event = " repeat " > 

<prompt> 

Your recording is <value 
expr="record__Record2 0 , 7> To keep it, say yes. To discard it, say no. 

</prompt> 
25 </catch> 
</field> 

<block> 

<assign name="Record2 0" expr="record_Record20 "/ > 
30 </block> 

<block> 

<goto next="#MENU_main"/> 
</block> 



35 



</f orm> 



<f orm id="MENUITEM_main_pay_bills"> 
<block name="link"> 
40 <goto next= M #FORM_payment_details M /> 

</block> 

</f orm> 

45 <var name= " payment jie tails " expr="new Object ()"/> 

<form id="FORM_j)ayment_details n > 
<grammar scope = "document " 
src= " demo2_8may . gsl#Formj?ayment_de t ai 1 s " / > 

50 <field name=" company" cond="f alse"/> 

<field name* "amount" cond="f alse"/> 
<field names »'payment_date" cond="f alse"/> 
<block> 

<assign name ="payTnent_de tails . company" expr= "company" / 
55 <assign name="payment_de tails . amount " expr= " amount "/> 

<assign name= "payment_de tails .payment_date" 
expr="payment_date"/ > 
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</block> 

<subdialog name= n payment_details_company n 
src=" #AS K_payment_de t ai 1 s_company " > 

<param name="payment__de tails" expr="payment_details"/> 
<filled> 

<assign name="payment_details" 
expr= "payment_details_company . payment_de tails " / > 
</filled> 
</subdialog> 



<subdialog name="paymentjdetails_amount " 
src= M #ASK_payment_details_amount "> 

<param name="payment_details" expr="payment_details"/> 
<filled> 

15 <assign name="payment_details" 

expr="payment_details_amount .payment_details"/> 
</filled> 
</ subdialog> 

20 <block> 

<if cond="payment_details . payment_date == undefined"> 
<script> 

< ! [CDATA [ 

payment_details . payment_date = new 



payment_de tails . payment__date . modifier 



25 ObjectO; 

= ■ today' ; 

]]> 

</script> 

30 </if> 
</block> 

<subdialog name="payment_details_payment_date n 
src=" #ASK_j?ayment_detai 1 s_payment_date " > 
35 <param name="payment_de tails " expr= "payment_de tails" /> 

<filled> 

<assign name = n payment_de tails " 
expr= "payment__details_payment_date . payment_de tails " / > 
</filled> 
40 </subdialog> 

<field name= n conf irm n > 

<grammar src="demo2_8may . gsl#Conf irm"/> 
<prompt> 

45 <value 

expr="PromptConfirm_j>ayment_de tails (payment_de tails .company, 
payment_detai Is . amount , payment_de tails .payment_date) "/> 
</prompt> 
<filled> 

50 <if cond=" confirm != 'yes'"> 

<assign name="payment_de tails .company" 

expr= "undefined" /> 

<assign name ="payment_de tails . amount" 

expr= "unde fined" /> 

55 <assign name="payment_de tails .payment_date u 

expr= "undefined" /> 

<clear/ > 
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</if> 
</filled> 

<catch event="help n > 
<prompt> 

5 <value 

expr="PromptHelp_Conf irm_payment_details () "/> 

</prompt> 
</catch> 

<catch event=" repeat 11 > 
10 <reprompt/> 

</catch> 

</field> 
<block> 

15 <goto next="#MENU_main"/> 

</block> 

</ f orm> 

20 <form id="ASK_payment_details_company" > 

<grammar src= M demo2_8may . gsl#Ask__payment_details__company " / > 

<var name= "payment_details " / > 

25 <block> 

<if cond="payment_details . company != undefined" > 
<return namelist= ,, payment__details "/ > 

</if> 
</block> 

30 

<field name=" company" cond= " false "/ > 
<field name= "amount " cond=" false" /> 
<field name="payment_date" cond="f alse" /> 
<initial name= " start " > 
35 <prompt count="l" bargein= " true" > 

<value 

expr= M PromptAsk__payment_details__company ( ) " / > 
< /prompt > 
</ initial> 
40 <filled mode="any"> 

<assign name="payment_de tails , company" 
expr= "merge (payment_details .company, company) "/> 

<assign name ="payment_de tails . amount" 
expr= "merge (payment_details . amount , amount) "/> 
45 <assign name= " payment __de tails .payment_date " 

expr= "merge (payment_details . payment__date , payment_date ) " / > 

<if cond="payment_details . company == undefined" > 
<clear/> 

</if> 

50 </filled> 
<block> 

<return namelist="payment_de tails "/> 
</block> 

55 



<catch event="help"> 
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15 



<prompt count bargein= n true n > 
<value 

expr= n PromptHelp_Ask_j)ayment_details_company () "/> 
< /prompt > 
</catch> 

<catch event= "repeat n > 

<reprompt/> 
</catch> 

</f orm> 

<f orm id="ASK_payment_details_amount "> 

<grammar src= "demo2_8may . gsl#Ask_j?ayment_details_amount " / > 

<var name="payment_details n /> 



<block> 

<if cond= "payment__det ails . amount != undefined" > 
20 <return namelist= "payment_details " /> 

</if> 
</block> 

<field name =" amount" cond= " false "/> 
25 <field name="payment_date" cond= " false " /> 

<initial name= "start "> 

<prompt count="l" bargein= " true " > 
<value 

expr= n Prompt As k__paymentjietails_amount () "/> 
30 < /prompt > 

</initial> 
< filled mode="any n > 

<assign name= "payment_detai Is . amount " 
expr=" merge (payment_de tails .amount, amount). "/> 
35 <assign name ="payment__de tails . payment_date " 

expr= "merge (payment_details . payment_date , payment__date) "/> 

<if cond="payment_details . amount == undefined" > 
<clear/ > 

</if> 

40 </f illed> 

<block> 

<return namelist="payment_de tails "/> 
</block> 

45 

<catch event="help H > 

<prompt count="l" bargein= n true"> 
<value 

50 expr== H PromptHelp_Askjpayment_details_amount { ) "/> 

< /prompt > 
</catch> 

<catch event="repeat"> 
55 <reprompt/> 
</catch> 
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</f orm> 

<form id= M ASKjayment_details_payment_date" > 
<grammar 

5 src= n demo2_8may .gsl#Ask_payment_details_j)aynient_date n /> 
<var name ="payment_de tails " /> 
<block> 

10 <if cond="payment_de tails .payment_date != undefined" > 

<assign name= "start " expr=" true 11 /> 
<goto nextitem="conf irm"/> 

</if> 
</block> 

15 

<field name="payment_date" cond="f alse"/> 
<initial name= " start " > 

<prompt count="l" bargein= M true " > 
<value 

20 expr= "Prompt As k_payment_de tail s_j?ayment_date { ) "/> 

< /prompt > 
</initial> 
<filled mode="any"> 

<assign name= "payraen t_de tails . payment_date" 
25 expr= "merge (payment_details .payment_date, payment_date) "/> 

<if cond="payment_details . payment_date == undefined" > 
<clear/> 

</if> 
</filled> 

30 

<field name="confirm"> 

<grammar src= "demo2_8may . gsl#Conf irm" / > 
<prompt> 

<value 

35 expr= " Prompt Conf irm_payment_details__payment_date (payment_details .payment^ 
date) "/> 

</prompt> • 
<f illed> 

<if cond="conf irm == 'yes'"> 
40 <return namelist="payment__details "/> 

<else/> 

<assign name="payment_de tails . payment _date" 

expr= "undefined"/ > 

<clear/> 

45 </if> 

</filled> 

<catch event =" he lp"> 
<prompt> 

<value 

50 expr="PromptHelp_Conf irm_j?ayment_de tails _jpayment_date () "/> 

< /prompt > 
</catch> 

<catch' event=" repeat "> 
<reprompt/> 
55 </catch> 

</field> 
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<catch event="help"> 

<prompt count= n l" bargein="true"> 
<value 

5 expr="PromptHelp_Ask_payment_details ^payment jdate () "/> 

< /prompt > 
</catch> 

<catch event= "repeat " > 
10 <reprompt/> 
</catch> 

</form> 

15 <form id="MEttfUITEM__main_quit n > 

<block> 

<exit/ > 
</block> 

20 </form> 

<form id="BRANCH_checkPINvalidity_l"> 
<block name= M link"> 

<goto next="#SPEAKER_failedPIN"/> 
25 </block> 

</form> 

<form id="SPEAKER__failedPIN"> 
30 <block> 

<prompt> 

You have not been authenticated. Goodbye. 
< /prompt > 
</block> 
35 <block> 

<exit/> 
</block> 



40 



</f orm> 



<form id="LOOP_authenticate"> 
<var name=" counter "/> 
<var name="get__PIN"/> 
<var name="validatePIN H /> 
45 <var name="call_get_balance"/> 

<var name="payment_details"/> 
<block> 

<assign name= "document . counter" expr= " counter" /> 
<assign name= M document . get_PIN" expr= M get_PIN'7> 
50 <assign name= "document . validatePIN" 

expr= "validatePIN" /> 

<assign name =" document . call_get_balance" 
expr= " call_get_balance » / > 

<assign name=" document . payment_de tails " 
55 expr= "payment_de tails " / > 
</block> 
<block> 
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<goto next= »' #LOOPINIT_authent ica t e " / > 
</block> 

</f orm> 

5 

<f orm id= " LOOPINIT_authent icate " > 
<block> 

<assign name=" counter" expr= M 0"/> 
<goto next ="#LOOPTEST_authent ica te"/> 
10 </block> 
</f orm> 

<f orm id="LOOPTEST_authent icate" > 
<block> 

15 <if cond="counter<3"> 

<goto next — #LOOPBODY_authenticate " / > 
<else/ > 

<goto next = " #LOOPEND_authenticate " / > 

</if > 

20 </block> 
</f orm> 

<f orm id="LOOPEND_authent icate " > 
25 <block> 

<prompt count="l" bargein= " true" > 

<value expr= "PromptLoopExi t_authent icate ( ) "/> 
</prompt> 

<return namelist= " counter get_PIN validatePIN 
30 call_get_balance payment_details "/> 
</block> 
</ f orm> 

<form id="LOOPSTEP_authent icate" > 
35 <block> 

<assign name= " counter" expr= "counter+1 " / > 
<goto next= " #LOOPTEST_authenticate « / > 
</block> 
</f orm> 



40 



45 



<f orm id= " LOOPBOD Y_au then t icate " > 
<block name=" link" > 

<goto next="#FORM_get_PIN"/> 
</block> 

</f orm> 



<var name="get_PIN" expr="new Object ()"/> 
<form id="FORM_get_PIN M > 
50 <field name="PIN" cond=" false "/> 

<block> 

<assign name = 11 ge t_P IN . P IN " expr="PIN"/> 
</block> 

<subdialog name= M get_PIN__PIN" src= "#ASK_get_PIN_PIN"> 
55 <param name="get_PIN" expr="get__PIN" /> 

<filled> 
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<assign name= "get_PIN" 
expr= "get_PIN_PIN . get_PIN" / > 
</filled> 
</subdialog> 

5 

<block name= M link"> 

<goto next = « #REMOTE_validatePIN " / > 
</block> 

10 </form> 

<form id="ASK_get_PIN_PIN"> 
<var name="get_PIN"/> 

15 <block> 

<if cond="get_PIN.PIN != undefined" > 
<return namelist="get_PIN M /> 

</if> 
</block> 

20 

<field name="PIN" modal= " true " > 
<link event =" he lp"> 

<grammar src= "demo2_8may . gsl#Help" /> 
</link> 

25 <link event="repeat "> 

<grammar src=" demo2_8may . gs l#Repeat » / > 
</link> 

<grammar src= u demo2_8may . gsl#Ask_get_PIN_PIN" /> 
<prompt count="l" bargein= n true"> 
30 <value expr="PromptAsk_get_PIN_PIN() »/> 

< /prompt > 

<prompt count="2" bargein=" true" > 

<value expr= " PromptAsk_get_PIN_PIN_2 ( ) " /> 
< /prompt > 
35 <filled> 

<assign name- "get_PIN . PIN" 
expr="merge (get_PIN . PIN, PIN) »/> 
</filled> 
</field> 



40 



45 



<block> 

<return namelist="get_PIN"/> 
</block> 



<catch event="help"> 

<prompt count= M l" bargein="true"> 

<value expr="PromptHelp_Ask_get_PIN_PIN () " /> 
< /prompt > 
50 </catch> 



55 



<catch event =" repeat "> 

<reprompt/ > 
</catch> 



</form> 
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<var name="validatePIN" expr=»new Object ()"/> 
<form id= u REMOTE_validatePIN"> 

<var name="sending_pam" expr=»get_PIN. PlN"/> 

<subdialog name= "remotecall " 

5 src*»http://videre. trl.telstra.com.au/~c797808/cgi-bin/verify pin.php" 
namelist="sending_pam M > 

<filled> 

<assign name=»validatePlN.x» expr= "remotecall ,x"/> 
</filled> 
10 </subdialog> 

<block name="link M > 

<goto next«»#DECISIONjpassOrFail" /> 
</block> 

15 </form> 

<form id="DECISION_passOrFail"> 
<block> 

?f) <if cond=»'validatePIN.x &apos ; PASS&apos ; " > 

U <goto next="#BRANCH_passOrFail_0"/> 

<else/> 

<goto next="#BRANCH_passOrFail l M /> 
</if> ~~ 
</block> 
25 </form> 

<form id="BRANCH_passOrFail_0"> 
<block> 

<return namelist= "counter get_PIN validatePIN 
j>U call_get_balance payment_de tails »/> 
</block> 

</form> 

35 <form id="BRANCH_passOrFail_l"> 

<block name="link" > 



<goto next="#SPEAKER_tryAgain"/> 
</block> 



40 </form> 



45 



<form id= n SPEAKER_tryAgain u > 
<block> 

<prompt> 

Your PIN is not valid. Please try again 
< /prompt > 
</block> 
<block> . 

<goto next=»#L00PSTEP authenticate » /> 
50 </block> 

</f orm> 

<scriptxi [CDATA [ 

55 
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function PromptHelp_Ask_get_PIN_PIN ( ) { 
var result; 

result = "please say the pin. for example, ten eighty six "; 
if ( valid_string (result) ) { 
return result; 

} 

; 

return result; 

} 



function PromptHelp_Conf irm_payment_details_payment_date ( ) { 
var result; 

result = "please say yes or no " ; 
if( valid_string (result) ) { 
15 return result; 

} 



return result; 

} 



function Confirmation (confirmation) { 
var result ; 
•if ( 

(confirmation == "yes" ) 
25 ) { 

result ■= "true " ; 
if ( valid_string (result )) { 
return result; 

} 

30 }; 

if ( 

(confirmation == "no" ) 

) { 

35 result = "false ■! ; 

if ( valid_string (result )) { 
return result; 

} 



} 



result = confirmation + " "; 
return result; 



45 function PromptConf irm_payment_de tails (company, amount , payment_date) { 
var result; 

result = "the company is " + Bpay_names (company) + "the amount is 
+ Money (amount) + "the payment date is " + Date (payment_date) + "is 
this correct? " ; 
50 if ( valid_string (result) ) { 

return result; 

} 

return result; 

55 } 
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function PromptConf irm_payment_details_payment_date (payment_date) { 
var result; 

result = "the payment date is " + Date (payment_date) + "is this 
5 correct? " ; 

if( valid_string (result) ) { 
return result; 

} 

10 return result; 

} 

function PromptMenu_main_leave_message ( ) { 
var result; 

15 result = "please say one of balance, enquiry, leave message, pay 

bills or quit (note: please respond with another phrase that means 'leave 
message * ) " ; 

if ( valid_string (result) ) { 
return result; 

20 } 



25 



return result; 

} 



function Integernum (integer ) { 
function Prompt Ask jpayment_de tai ls_amount ( ) { 
var result; 

result = "please say the amount " ; 
30 if ( valid_string (result) ) { 

return result; 

} 

return result; 

35 } 

function Bpay_names (bpay_names ) { 
var result; 
if ( 

40 (bpay_names == "telstra" ) 

) { 

result = "telstra "; 
if ( valid_string (result) ) { 
return result; 

45 } 

}; 

if ( 

(bpay_names == "origin energy" ) 
50 ) { 

result = "origin energy 11 ; 
if ( valid_string (result) ) { 
return result; 

} • 

55 }; 

if ( 
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(bpay_names == "citipower" ) 

) { 

result = "citipower 
if ( valid_string (result) ) { 
5 return result; 

} 

}; 

result = bpay_names + 11 " ; 

10 return result; 

} 

function PromptHelp_Ask_payment_details__amount ( ) { 
var result; 

15 result = "please say the amount, for example, three dollars and fifty 

cents " ; 

if ( valid_string (result )) { 
return result; 

} 



20 



return result; 

} 



function PromptMenu_main ( ) { 
25 var result; 

result = "please say one of balance, enquiry, leave message, pay 
bills or quit " ; 

if ( valid_string (result )) { 
return result; 

30 } 

return result; 

} 

35 function PromptConf irmation (confirmation) { 
var result; 

result = Confirmation (confirmation) ; 
if ( valid_string (result) ) { 
return result; 

40 } 

/ 

return result; 

} 

45 function Prompt He lp_Ask_payment_details_payment_date ( ) { 
var result; 

result = "please say the payment date, for example, january the fifth 
nineteen ninety nine "; . 

if( valid_string (result) ) { 
50 return result; 

} 

return result; 

} 

function AM ( ) { 
var result; 
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result = "in the morning "; 
if ( valid_string (result) ) { . 
return result; 

} 

5 ; 

return result; 

} 

function PM() { 
var result; 
10 result = "in the " + EVENING ( ) 

if( valid_string (result) ) { 
return result; 

} 

; 

15 return result; 

} 

function Prompt Integer (integer) { 
var result; 
20 result = Integer (integer) ; 

if ( valid_string (result )) { 
return result; 

} 

25 return result; 

} 



30 



] ] ></script> 
< /v.xml > 
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CLAIMS: 

1 . A process for developing a voice application, including: 
generating graphical user interface components for defining execution paths of said 

application by arranging dialog elements in a tree structure, each path through said tree 
structure representing one of said execution paths; 

generating said dialog elements on the basis of predetermined templates and 
properties of said dialog elements, said properties received from a user via said graphical 
user interface components, each of said dialog elements corresponding to at least one voice 
language template; and 

generating at least one voice language module for said application on the basis of 
said at least one voice language template and said properties. 

2. A process as claimed in claim 1, wherein the voice language templates include 
1 5 VoiceXML elements. 

3. A process as claimed in claim 2, wherein said at least one voice language module 
includes extended VoiceXML elements including VoiceXML tags and additional 
information to allow said dialog elements to' be generated from said at least one voice 

20 language module. 

4. A process as claimed in claim 3, wherein said additional information includes one 
or more attributes of said VoiceXML tags. 

25 5. A process as claimed in claim 4, wherein said one or more attributes include 
qualified names. 



5 



10 



6. A process as claimed in claim 1, wherein each of said at least one voice language 
modules includes a reference to the next of said at least one voice language modules in an 
30 execution path of said application. 
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7. A process as claimed in claim 1, including generating a graphical representation of 
said dialog elements and said execution paths on the basis of said at least one voice 
language module. 

5 8. A process as claimed in claim 1, including generating extended VoiceXML code, 
prompt data, and grammar data for said application. 

9. A process as claimed in claim 8, wherein said prompt data is represented as a 
grammar, and said process includes improving said grammar. 

10. A process as claimed in claim 1, including generating at least one script for 
generating a prompt for said application on the basis of one or more parameters supplied to 
said script. 

15 11. A process as claimed in claim 10, wherein said at least one script is generated on 
the basis of at least one script template and prompt data defined for said prompt by a user. 

12. A process as claimed in claim 1 1, wherein said at least one script includes 
EMCAscript. 

20 

13. A process as claimed in claim 8, including generating VoiceXML code and IVR 
grammar data for execution of said application on an IVR system on the basis of said 
extended VoiceXML code, prompt data, and grammar data. 

25 14. A system having components for executing a process as claimed in any one of the 
preceding claims. 

15. Program code for executing a process as claimed in any one of claims 1 to 13. 

30 16. A computer readable storage medium having stored thereon program code for 
executing a process as claimed in any of claims 1 to 13. 
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17. A system for use in developing a voice application, including: 

a dialog element selector for defining execution paths of said application by 
selecting dialog elements and adding said dialog elements to a tree structure, each path 
5 through said tree structure representing one of said execution paths; 

a dialog element generator for generating said dialog elements on the basis of 
predetermined templates and properties of said dialog elements, said properties received 
from a user of said system, each of said dialog elements corresponding to at least one voice 
language template; and 

10 a code generator for generating at least one voice language module for said 

application on the basis of said at least one voice language template and said properties. 

18. A system as claimed in claim 17, wherein said selector is adapted to generate a 
graphical representation of said dialog elements and said execution paths on the basis of 

15 said at least one voice language module. 

19. A system as claimed in claim 17, wherein said code generator is adapted to 
generate extended VoiceXML code, prompt data, and grammar data for said application. 

20 20. A system as claimed in claim 19, wherein said prompt data is represented as a 
grammar, and the system includes one or more modules for improving said grammar. 

21. A system as claimed in claim 17, including a script generator for generating at least 
one script for generating a prompt for said application on the basis of one or more 

25 parameters supplied to said script. 

22. A system as claimed in claim 21, wherein said script generator is adapted to 
generate said at least one script on the basis of at least one script template and prompt data 
defined for said prompt by a user. 
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23. A system as claimed in claim 19, wherein said code generator is adapted to 
generate VoiceXML code and IVR grammar data for execution of said application on an 
IVR system on the basis of said extended VoiceXML code, prompt data, and grammar 
data. 

5 

24. An extended VoiceXML file generated by a system as claimed in any one of claims 
17 to 23. 



25. A graphical user interface for use in developing a voice application, said interface 
10 including graphical user interface components for defining execution paths of said 
application by arranging configurable dialog elements in a tree structure, each path through 
said tree structure representing one of said execution paths, and said dialog element 
components may include one or more of: 

a start dialog component for defining the start of said application; 
15 a variables component for use in defining variables for said application; 

a menu component for defining a menu; 
a menu choice component for defining a choice of said menu; 
a decision component for defining a decision branching point; 
a decision branch component for defining a test condition and an execution branch 
20 of said decision branching point; 

a form component for defining a form to collect input from a caller; 
a record component for recording audio 
a speaker component for playing prompts, 
a local processing component for defining local processing; 
'25 a remote processing component for performing processing on a remote system; 

a loop component for defining an execution loop; 
a loop call component for calling said loop; 

a loop next component for proceeding to the next cycle of said loop; 
a loop break component for breaking out of said loop; 
30 a subroutine component for defining a subroutine; 

a subroutine call component for calling said subroutine; 
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subroutine return component for returning from said subroutine; 
a jump component for defining a non-sequential execution path to a dialog element 
a transfer component representing the transfer of a call to another number 
a hotwords component for defining a word or phrase and a non-sequential 
5 execution path to a dialog element to be followed upon receipt of said word or 

phrase; and 

an end component for defining an end of said application. 
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